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CHAPTER  ONE 


INTRODUCTION 

1.1.  Overview 

Traditional  surveillance  and  communication  systems  use 
a  single  sensor  such  as  a  radar  or  a  sonar  for  the  detection, 
identification  and  tracking  of  targets.  In  these  systems, 
complete  sensor  observations  are  available  at  a  central 
location  and  classical  hypothesis  testing  and  estimation 
procedures  are  employed  for  signal  processing  [1}.  There  is 
an  increasing  interest  in  simultaneously  employing  several 
sensors  and  sensing  techniques,  such  as,  sonics ,  microwave, 
infra-red  and  X-ray  sensors.  The  basic  goal  of  such  mul¬ 
tiple  sensor  systems  is  to  improve  system  performance,  e.g., 
reliability  or  speed.  This  can  be  achieved  by  properly 
combining  the  information  obtained  from  the  various  sensors. 
Other  factors  which  have  necessitated  the  use  of  multiple 
sensors  are  the  increase  in  the  number  of  targets  under  con¬ 
sideration  and  the  increase  in  required  coverage. 

The  decomposition  of  processing  is  essential  for 
controlling  the  complexity  of  computation.  Central  compu¬ 
tation  is  just  too  costly  in  both  memory  and  time.  Moreover, 
the  distribution  of  computation  may  enable  us  to  use  parallel 


processing.  This  will  reduce  the  computation  time  which 
often  grows  exponentially.  Furthermore,  for  large-scale 
complex  systems,  a  distributed  implementation  is  almost 
essential.  Also,  as  the  external  environment  changes, 
adaptation  to  change  is  easier  in  distributed  processing 
systems.  In  a  complex  information  system  comprising  of  a 
very  large  number  of  sensors  and  a  large  volume  of  infor¬ 
mation,  a  central  processor  will  require  a  very  large  band¬ 
width,  and  therefore  a  distributed  implementation  will  be 
much  more  attractive. 

Distributed  processing  of  signals  is  a  natural  way 
to  treat  the  problem  of  hypothesis  testing  when  there  are 
many  sensors  located  at  different  geographical  sites.  In 
general,  classical  statistical  decision  theory  can  not  be 
used  to  solve  problems  that  fall  into  a  distributed 
decision-making  framework.  The  mathematical  tools  that  we 
have,  usually  assume  a  centralized  configuration  and  can  be 
employed  to  handle  the  hypothesis  testing  problems  for 
systems  shown  in  Figures  1.1  and  1.2.  Note  that  in  the 
system  of  Figure  1.2,  raw  data  from  the  multiple  sensors  is 
transmitted  to  the  data  fusion  center  for  centralized  pro¬ 
cessing.  Organizing  a  community  of  decision  makers  to 
perform  a  global  task  is  a  challenging  problem.  Even 
problems  that  are  trivial  in  a  centralized  setting  become 
very  difficult  in  a  distributed  environment.  To  illustrate 
the  difficulties,  consider  the  binary  Bayesian  hypothesis 
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testing  problem  for  the  system  shown  in  Figure  1.1.  The 
decision  rule  at  the  data  fusion  center  is  obtained  using 
the  well  known  result  in  classical  detection  theory  [lj. 

The  decision  rule  is  a  likelihood  ratio  test  (LRT),  where 
the  value  of  the  threshold  is  determined  by  the  a  priori 
probabilities  and  costs.  In  the  distributed  configuration 
as  shown  in  Figure  1.3,  the  objective  of  the  network  con¬ 
sisting  of  all  the  decision  makers  is  to  minimize  a  joint 
cost  function.  Tenney  and  Sandell  [2]  have  solved  the  prob¬ 
lem  and  have  shown  that  each  decision  maker  implements  a  local 
likelihood  ratio  test,  However,  the  thresholds  are  coupled 
and  are  obtained  by  solving  a  set  of  coupled  nonlinear  equa¬ 
tions.  In  most  cases,  the  solution  of  these  nonlinear  equa¬ 
tions  is  a  difficult  matter. 

The  goal  in  this  Report  ,  is  to  consider  some 

distributed  signal  detection  problems  where  the  signal  pro¬ 
cessing  is  not  centralized.  The  detection  network  consists 
of  a  multitude  of  geographically  distributed  sensors  which 
collect  observations  from  the  environment.  The  problem  is 
to  design  a  distributed  detection  system  that  processes  the 
noisy  observations  from  these  geographically  distributed 
sensors  and  fuses  the  partially  processed  data  to  perform 
a  global  task.  The  objective  of  the  work,  reported  in  this 
Report  ,  is  to  solve  problems  that  will  extend  the 
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boundaries  of  classical  detection  theory  to  a  distributed 
framework.  In  the  next  section,  we  discuss  the  previous 
work  on  the  subject  that  has  been  reported  in  the  literature. 

1.2.  Previous  Work 

Some  recent  work  on  the  detection  problem  with  multiple 
sensors  has  been  reported  in  the  literature.  Tenney  and 
Sandell  [2],  in  their  important  effort,  have  extended  the 
classical  binary  Bayesian  decision  theory  to  the  case  of  two 
distributed  sensors.  This  extension  does  not  yield  results 
which  are  straightforward  extensions  of  the  classical  re¬ 
sults.  The  computation  of  detector  thresholds  at  individual 
detectors  is  usually  coupled.  Further  work  along  these 
lines  has  been  performed  in  [2-9].  Sadjadi  [3],  extended 
the  results  of  [2]  to  the  case  of  N  decentralized  sensors 
and  M  hypotheses.  Lauer  and  Sandell  [4],  considered  the 
Bayesian  detection  of  signal  waveforms  in  the  presence  of 
noise.  Ekchian  and  Tenney  [5]  formulated  the  Bayesian  de¬ 
tection  problem  for  various  distributed  sensor  network 
topologies.  Each  member  of  a  team  of  decision  agents  re- 
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ceives  a  conditionally  independent  observation  about  some 
discrete  hypothesis.  The  decision  makers  seek  to  optimize 
a  team  cost  function  by  making  discrete  decisions  which  are 
then  transmitted  to  other  decision  makers  depending  upon 

the  topology.  They  derive  the  optimal  decision  rules  for 
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each  decision  maker  which  turn  out  to  be  LRT's.  Ekchian 
and  Tenney  in  [6],  presented  a  general  recursive  methodology 
for  computing  the  optimal  decision  rules  for  each  decision 
maker  for  a  tandem  topology.  This  is  achieved  by  reformu¬ 
lating  the  stochastic  optimal  control  problem  as  an  equiva¬ 
lent  deterministic  one.  The  problem  is  then  decomposed  into 
subproblems  which  can  be  recursively  solved  using  dynamic 
programming  techniques.  Kushner  and  Pacut  [8]  performed  a 
simulation  study  for  a  distributed  detection  problem  using 
exponential  distributions.  Tsitsiklis  and  Athans  [9]  demon¬ 
strated  that,  in  general,  distributed  hypothesis  testing 
problems  are  N-P  complete.  Their  research  provided  theo¬ 
retical  evidence  regarding  the  inherent  complexity  of 
solving  optimal  distributed  decision  problems  as  compared 
to  their  centralized  counterparts. 

The  decentralized  sequential  detection  problem  has 
been  investigated  in  [10-12].  In  [10],  Teneketzis  formu¬ 
lated  and  solved  a  decentralized  version  of  the  Wald's 
problem  [13].  In  his  model,  each  detector  is  given  the 
flexibility  of  either  stopping  and  making  a  decision  or 
continuing  to  take  more  observations.  He  showed  that  the 
person  to  person  optimal  policies  of  the  detectors  are  de¬ 
scribed  by  thresholds  which  are  coupled.  More  specifically, 
the  thresholds  of  detector  i  at  any  instant  of  time  depend 
on  the  thresholds  of  detector  j,  j*l,2,...,N,  j  f  i,at  all 
past,  present  and  future  times.  For  a  two-detector  N-stage 
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detection  system,  he  showed  that  the  thresholds  are  de¬ 
termined  by  solving  a  set  of  4N-2  equations  in  4N-2  un¬ 
knowns.  Hashemipour  and  Rhodes  [11]  solved  an  N-stage,  two- 
detector  decentralized  sequential  hypothesis  testing  problem. 
In  their  model,  each  detector  takes  an  observation  and  makes 
a  binary  decision  which  is  sent  to  the  data  fusion  center. 

The  fusion  center  is  given  the  option  of  either  stopping  and 
making  a  decision  as  to  which  hypothesis  is  true  or  continu¬ 
ing  to  the  next  time  stage.  It  is  shown  that  at  each  time 
instant,  the  optimal  local  strategies  are  LRT's.  Further¬ 
more,  it  is  shown  that  the  local  decisions  depend  not  only 
on  the  present  and  past  observations,  but  on  the  past  local 
decisions  as  well.  In  [12],  the  decentralized  quickest 
detection  problem  has  been  considered.  Tsitsiklis  [14], 
considered  a  decentralized  detection  problem  in  which  a 
number  of  identical  sensors  transmit  a  binary  function  of 
their  observations  to  a  fusion  center  which  then  decides 
which  one  of  the  two  alternative  hypothesis  is  true.  He 
showed  that,  when  the  number  of  sensors  grows  to  infinity, 
optimality  is  not  lost  if  we  constrain  the  sensors  to  use 
the  same  decision  rule  in  deciding  what  to  transmit.  Re¬ 
cently  Hoballah  [15]  solved  various  problems  in  distributed 
hypothesis  testing.  He  solved  the  distributed  detection 
problem  with  data  fusion  using  both  the  Bayesian  and  Neyman 
Pearson  approaches.  Other  related  work  appeared  in  [16,  21]. 


^-\>V 


im 


In  this  Report  ,  we  consider  some  distributed 
detection  problems.  We  will  derive  the  optimal  decision 
rules  for  the  various  distributed  sensor  network  topologies 
using  a  variety  of  optimality  criteria. 

In  Chapter  Two,  we  present  the  derivation  of  the  optimal 
decision  rule  at  the  data  fusion  center  for  the  distributed 
detection  problem.  We  use  two  configurations  for  the  data 
fusion  center,  one  centralized  and  the  other  distributed. 

We  assume  that  the  local  decisions  and  the  thresholds  of  all 
the  detectors  are  known  a  priori. 

In  Chapter  Three,  we  solve  the  problem  of  distributed 
Bayesian  hypothesis  testing  with  distributed  data  fusion. 

We  derive  the  decision  rules  both  at  the  detectors  and  at 
the  data  fusion  centers.  An  example  is  presented  to  illus¬ 
trate  the  results  of  this  chapter. 

In  Chapter  Four  ,  we  solve  the  problem  of  distributed 
Neyman-Pearson  hypothesis  testing  for  various  network  topolo¬ 
gies.  First,  we  formulate  and  solve  the  distributed  detection 
problem  for  a  two-detector  tandem  topology.  Then  we  extend 
the  results  in  two  directions.  First,  wt  solve  the  problem 
of  distributed  Neyman-Pearson  hypothesis  testing  with  distri¬ 
buted  data  fusion.  Then,  we  consider  the  problem  of  distributed 
Neyman-Pearson  hypothesis  testing  for  a  N-detector  tandem 
topology.  An  example  is  presented  to  illustrate  the  results 
of  this  chapter. 
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In  Chapter  Five,  we  present  the  derivation  of  the 
optimal  decision  rule  for  a  decentralized  sequential  detec¬ 
tion  problem  using  the  Neyman- Pearson  approach.  Furthermore, 
we  solve  the  Bayesian  sequential  hypothesis  testing  problem 

for  a  tandem  topology  configuration. 

In  Chapter  Six,  a  summary  of  results,  conclusions, 
and  suggestions  for  future  research  are  presented. 
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CHAPTER  TWO 


OPTIMAL  DATA  FUSION  IN  MULTIPLE  SENSOR 
DETECTION  SYSTEMS 

2 . 1  Introduction 

Tenney  and  Sandell  [2],  have  treated  the  Bayesian 
detection  problem  with  distributed  sensors.  They  only  con¬ 
sidered  the  design  of  decision  rules  at  the  individual 
sensors  and  did  not  consider  the  design  of  data  fusion 
algorithms.  In  this  chapter,  we  investigate  the  latter 
problem,  i.e.,  the  design  of  data  fusion  algorithms  when 
the  decision  rules  at  the  individual  sensors  are  known.  We 
consider  two  major  options  for  signal  processing  in  multi¬ 
sensor  systems  with  data  fusion.  In  the  first  option,  all 
sensors  report  to  a  centralized  computing  facility  as  shown 
in  Figure  2.1.  This  is  the  conventional  configuration  for 
a  multi-sensor  system  with  data  fusion.  Some  signal  pro¬ 
cessing  is  done  at  the  local  sensor,  and  partial  results 
are  transmitted  to  the  data  fusion  center  for  further  pro¬ 
cessing.  Global  results  can  then  be  obtained  at  the  data 
fusion  center.  This  option  is  attractive  for  many  appli¬ 
cations  due  to  the  communication  bandwidth  constraints  found 
in  practice.  The  principal  weakness  of  this  configuration 
is  its  vulnerability  to  the  loss  of  the  data  fusion  center. 
The  second  option  is  to  have  a  distributed  data  fusion  con- 


Phenomenon 


figuration  as  shown  in  Figure  2.2  (only  three  sensors  are 
shown  for  the  sake  of  clarity).  In  this  option,  some  signal 
processing  is  done  locally  at  the  sensor  and  partial  results 
are  transmitted  to  all  of  the  local  data  fusion  centers  for 
further  processing.  Global  results  can  then  be  obtained  at 
all  of  the  data  fusion  centers.  This  option  is  attractive 
for  many  applications  because  it  is  more  robust  than  the 
centralized  configuration  in  terms  of  its  vulnerability  to 
the  loss  of  the  data  fusion  center.  Furthermore,  each  de¬ 
cision  maker  in  the  distributed  configuration  has  access  to 
the  actual  raw  data  at  that  site  which  may  result  in  a  per¬ 
formance  enhancement. 

In  this  chapter,  we  consider  the  problem  of  optimal 
decision  combining  in  multiple  sensor  detection  systems. 

In  Section  2.2,  we  derive  the  optimum  fusion  rule  for  the 
centralized  configuration  when  the  individual  detector  de¬ 
cision  rules  are  known.  The  combining  rule  turns  out  to  be 
a  function  of  the  probability  of  false  alarm  and  probability 
of  miss  of  individual  detectors,  i.e.,  the  reliability  of 
individual  detectors.  An  example  is  presented  to  illustrate 
the  result.  In  Section  2.3,  we  derive  the  optimum  fusion 
rules  for  the  distributed  configuration  when  the  individual 
detector  decision  rules  are  known.  The  combining  rule  at  a 
fusion  site  turns  out  to  be  a  function  of  the  probability 
of  false  alarm  and  the  probability  of  miss  of  the  in¬ 
coming  decisions  from  the  other  decision  makers,  and  its 
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own  observation.  An  example  is  presented  to  illustrate  the 

result.  Finally  the  results  of  this  chapter  are  discussed 

in  Section  2.4. 

2.2.  Optimal  Centralized  Data  Fusion 

2.2.1.  Problem  Statement  and  Solution 

Let  us  consider  a  binary  hypothesis  testing  problem 
with  the  following  two  hypotheses: 

Hq  -  signal  is  absent,  and 

H-^  -  signal  is  present. 

The  a  priori  probabilities  of  the  two  hypotheses  are  denoted 
by  P(Hq)  =  Pq  and  P(H^]  =  P^ .  As  shown  in  Figure  2.1,  we 
assume  that  there  are  N  detectors,  ,  i=l,...,N,  and  the 
observations  at  each  are  denoted  by  y^,  i*l,...,N.  We 

will  further  assume  that  the  observations  at  the  individual 
detectors  are  statistically  independent  and  that  the  condi¬ 
tional  density  function  of  the  observations  is  denoted  by 
P  Cy i I H j  3 ;  i=l,...,N;  j-0,1.  The  independence  assumption 
implies  that 

p ^yi  I  yj  ’  Hk)  =  p Cy i  I  Hk^  for  1  t  J  •  (2-1) 

Each  detector,  D^,  employs  a  decision  rule  g^(y^)  to  make  a 
decision  u^,  i=l,2,...,N,  where 

{0  if  H  is  declared 

(2-2) 

1  if  is  declared 


We  denote  the  probabilities  of  false  alarm  and  miss  of  each 


detector  by  Ppp  and  P^p  respectively.  These  error  probabili¬ 
ties  are  defined  as 


P_.  =  Prob.  [u.  =  1 | H  ]  and 
Fi  L  1  '  oJ 

(2-3) 


PMi  4  Prob.  [Up  =  0 ] Hp }  =  l-PDi. 

After  processing  the  observations  locally,  the  decisions  up 
are  transmitted  to  the  data  fusion  center  as  shown  in  Figure 
2.1.  The  centralized  data  fusion  center  determines  the 
overall  decision  uq  for  the  system,  based  on  the  individual 
decisions ,  i . e  .  , 


uo  =  Y(Up,  u2, . . .  ,  uN)  . 


(2-4) 


Our  objective  is  to  find  the  optimal  data  fusion  rule 
when  the  individual  detectors  have  already  been  designed. 
Data  fusion  rules  are  often  implemented  as  "k  out  of  N" 
logical  functions.  This  means  that  if  k  or  more  detectors 
decide  hypothesis  Hp ,  then  the  global  decision  is  Hp ,  other¬ 
wise  it  is  H  ,  i.e., 
o 


u 


o 


if  u,  +  u-  +  ...  +  uX7  >  k 
12  N  — 

otherwise  , 


(2-5) 


where  Up  e  {0,1}  for  i  =  1,2,...,N.  Common  logical  functions 
such  as  AND,  OR,  and  majority  gate  are  special  cases  of  the 
'k  out  of  N"  rule.  In  this  section,  we  will  consider  a  more 
general  formulation  of  the  data  fusion  problem.  The  data 


fusion  problem  can  be  viewed  as  a  two-hypothesis  detection 
problem  with  individual  detector  decisions  being  the  observa¬ 
tions.  The  optimum  decision  rule  is  obtained  by  minimizing 
the  overall  risk  function  R  defined  as  follows: 


R  =  E(J(u0,  H)} 


(2-6) 


where 


uQ  =  global  decision, 


H  =  hypothesis  . 

Our  aim  is  to  minimize  R  with  respect  to  all  the  uncertain¬ 
ties  present  (u^,...,u^  and  H)  over  all  possible  strategies 


Y,  i.e. 


mm 

Y 


Eu,H  JtY(u),  H  ] 


(2-7) 


where 


u  (u^  1 1*2  $  *  •  *  t  Ujj) 


uo  =  y(u) 


uq  e  {0,1} 


and 


J(u  =  i,  H-)  =  cost  of  deciding  u  =  i  when  H. 
v  o  *  j  °  o  j 


is  present. 

Consequently,  the  problem  faced  by  the  data  fusion  center 
is  centralized  in  nature  and  can  be  solved  using  the  classi¬ 
cal  approach.  The  result  is  presented  in  Theorem  2.1. 


Theorem  2.1 


Given  N  detectors  D^,  i=l,2,...,N,  along  with  their 


associated  decision  rules  operating  at  the  point  (P^,  Ppp) 
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of  the  Receiver  Operating  Characteristic  (ROC) ;  the  optimal 
centralized  data  fusion  rule  is  given  by 


N 


p(u|Ho)  =  n  p (ui | HQ)  =  n  pfui=i  |Ho)  n  pfu^ol^) 


i=l 


n  p  n  Ci  -  PFi) 

s+  s_  ^ 


(2-11) 


Substituting  (2-10)  and  (2-11)  into  (2-9)  and  taking  the 
logarithm,  we  get 


1  -  PM* 

Mi 


r>  U  =1 

Pw  •  O  . 
Mi  > 


IVJio"Joo-) 


P(u|H^)  r  Ml  .  v  i  _  mi  •;  o-  iu  uu 

ln  n  f*n  HT T  =  I  ln  ~V -  +  1  ln  TTp -  <  ln  P  TJ  -J - T 

p(u|Ho)  PFi  S _  1  PFi  uo  =  0  *1  ^01  11J 

(2-12) 

A  manipulation  of  (2-12)  yields  the  desired  result  which 
completes  the  proof.  Q.E.D. 

Note  that,  we  may  also  express  the  data  fusion  rule  as 

,  .  v  ^  J10'J00 

1  lf  an  +  1  a-(2u.-l)  >  In  -- - — 

o  .=1  i  i  J01  Jn 


u„  =  y(u1,u2,. . . ,uM)  = 


N- 


^0  otherwise 


(2-13) 


where 


a  =  In  -5— 
o  P 


_1 

> 

o 


1  -  P 


a .  -  ln  — « — 
1  Pn  • 


Mi 


and 


Fi 
1  -  P 


a  -  =  ln 


Fi 


Mi 


if  u.  =  1 
1 


if  u -  =  0  . 
1 


(2-14) 


The  optimum  data  fusion  rule  can  be  implemented  as  shown  in 
Figure  2.3.  As  we  can  observe,  individual  detector  decisions 
are  weighted  according  to  their  reliability,  i.e.,  the  weights 
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y'yy/A 
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mm 


are  functions  of  probability  of  false  alarm  and  probability 
of  miss.  The  data  fusion  center  structure  obtained  here 
attempts  to  optimally  use  the  individual  detector  decisions 
by  forming  a  weighted  sum  and  then  comparing  it  to  a  thresh¬ 
old  . 


2.2.2.  Example 

We  consider  a  simple  binary  hypothesis  problem  with  two 
detectors  D1  and  T>y  The  probabilities  of  false  alarm  are 
given  to  be  Ppi  =  Pf2  =  and  the  probabilities  of  miss  are 
given  to  be  PM1  =  PM2  =  j-  We  assume  the  hypotheses  to  be 
equally  likely,  i.e.,  PQ  =  =  \  and  choose  the  minimum 

probability  of  error  cost  function,  i.e.,  J0Q  =  J-j^  =  1, 

J01  =  J10  =  °*  Now’  the  °Ptimum  data  fusion  rule  is  obtained 
using  Theorem  2.1.  We  consider  the  case  when  ui  =  u2  =  1 ' 
The  log-likelihood  ratio  is  given  by 


PCH-jJu) 

;  ln  pi^TaT  ' 

! 

I 

;  Since  it  is  greater 

]  is  H,.  The  results 

f  1 

l  are  summarized  below 


~  ,  3 

2  In  |  . 

than  the  threshold  zero,  the 
for  the  other  combinations  o 


(2-15) 

decision 
f  u^  and  u2 
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Note  that  the  fusion  rule  turns  out  to  be  the  AND  rule. 


Depending  on  the  values  of  PQ,  P1,  PMi,  Ppi  and  the  costs, 
the  fusion  rule  can  be  some  other  logical  function. The  ROC 
curve  for  this  example  is  shown  in  Figure  2.6. 


2.3.  Optimum  Distributed  Data  Fusion 


2.3.1  Problem  Statement  and  Solution 


In  this  section,  we  consider  the  same  binary  hypothesis 


testing  problem  as  stated  in  Section  2.2.1  for  the  distri¬ 


buted  data  fusion  configuration.  In  this  system,  after  pro¬ 


cessing  the  observations  locally,  i.e.,  at  the  level  of  the 


detectors,  the  decisions  u^  are  transmitted  to  all  the  local 


data  fusion  centers  for  further  processing  as  shown  in 


Figure  2.4.  Now,  we  describe  the  sequence  of  operations  at 


the  ith  sensor,  i.e.,  at  the  detector  D^,  and  the  data  fusion 


center  i,  DF^.  First,  D^  takes  an  observation  y^  and  based 

on  y^  makes  a  decision  u^.  Then,  the  decision  u^  e  {0,1} 

is  transmitted  to  all  the  data  fusion  centers  DF^,  k=l,...,N, 

k  ^  i.  After  receiving  the  decisions  u^,  k*l,...,N,  k  f  i, 

from  the  other  detectors,  DF.  makes  a  final  decision  ur. 

’  l  f  l 


based  on  {u,  ,  k=l,...,N,  k  t  i}  and  y..  In  the  distributed  data 

K  X 


fusion  problem,  our  goal  is  to  derive  the  optimum  decision 


rules  to  obtain  the  final  decisions  u^  ,  i  =  l ,  .  .  .  ,N .  This  pro¬ 
blem  can  again  be  viewed  as  a  two -hypothes is  detection  problem 


at  each  site.  The  individual  detector  decisions  u.'s  and  the 

i 


measurement  v.  at  each  site  are  the  set  of  observations,  i.e., 

l 


the  data  fusion  center  DF^  receives  the  set  of  observations 
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I.  ={  uk’  k=1»-***N>  k^i  and  yi}>  Based  on  Ii»  DPi 
makes  a  final  decision  u^,  i.e., 


u,..  =  y.  (I . ) 
fi  11 


(2-16) 


We  wish  to  find  the  optimal  data  fusion  rule  at  DF^, 
i  =  1,...,N.  The  risk  function  ,  i=l,...,N,  at  DF^  is 


defined  as 


R.  »  E[JCufi,  H)] 


(2-17) 


Our  aim  is  to  minimize  R^^  with  respect  to  all  uncertainties 
present  (1^,  H)  over  all  possible  strategies  y^,  i.e., 

min  Ej  ^vHy^,  H)  • 

Yi  1 

The  optimal  data  fusion  strategy  at  DF^  for  the  distributed 
data  fusion  configuration  is  given  in  the  following  theorem. 

Theorem  2.2 

Given  N  detectors  along  with  their  associated 
decision  rules  and  operating  points  (PD^>  Pp^),  and  N  data 
fusion  centers  DF^,  i=l,...,N;  the  optimal  distributed 
data  fusion  rule  at  the  site  i  is  given  by 


Pi  1-P„.  Pu.  p(y.  | HO  ufi_1 

'I  -  1% u  J-o 


J10  ‘  Joo 


'01  J11 


(2-18) 
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where 


=  the  set  of  all  j  such  that  =  1,  j  f  i. 

-  the  set  of  all  j  such  that  u.  =  0,  j  /  i, 

(2-19) 

Proof : 

The  objective  is  to  find  the  strategy  ^  so  as  to 
minimize  E  H)},  i=l, — ,N.  This  is  a  classical 

detection  problem,  the  solution  is  given  by  the  following 
likelihood  ratio  test 


U.,  =1 


N  p(uk|H1)  pC/ilHj)  Ufi=1  J10-J00  P0 

U  _  r..m  i  t't — r  *  — -rr. — rrr — r  Z  T - _  T 


k=l  ^uk'"o 

Mi 


i 1  O'  ufi  =  0  -01  U11  rl 


(2-25) 


Taking  the  logarithm  of  both  sides  of  (2-25),  and  proceeding 
as  in  the  proof  ^f  Theorem  2.1,  we  have 


in  £  + 

0  sj;  Fj 


I  ^  r 


P^tlHp  “ff1  J10-J00 

Ptyi.lH0J  uf?»0  J0l"'ll 


(2-26) 


which  completes  the  proof.  Q.E.D. 

The  data  fusion  rule  at  the  site  i  can  be  implemented  as 
shown  in  Fig.  2.5,  where 

*1 

ao  -  ln  FT 


ai  "  1,1  “P - -  »i£  Ui  =  l> 

*Fi 


1  '  PFi 

ai  =  ln  ~rr —  >if  ui  =  0> 

Ml 


(2-27) 


for  j  f  i. 


2.3.2.  Example 


We  consider  the  same  example  as  in  Section  2.2.2, 
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We  further  assume  that  the  conditional  densities  p(y^Hj), 
i=l,2,;  j=0,l,  are  exponential,  i.e., 

p Cy i |hq)  =  x  exp  (-  xyA) 

p(yi|H1)  =  2 A  exp  (-2xyi)  .  X>0,  i-1,2 

for  y.  >  0, 

and 

p(y.jjHj)  =  0.  i  =  l,2  ,  j  =  0,l  elsewhere.  C  2  -  28) 

Using  Theorem  2.2,  we  obtain  the  optimum  data  fusion  rule 
for  this  problem.  We  first  consider  the  case  when  u2=^> 
and  in  this  case  we  obtain  the  data  fusion  rule  at  the 
site  1.  We  have 


1  -  P  P 

In [ 2  exp (-Ay, ) ]  +  In  — - — —  +  In  pi 
1  *F2  *0 


Ufi~l 


J10  '  J00 


<  -*-n  j  -  J 

ufj=0  J01  J11 


(2-29) 


Substituting  the  numerical  values  in  (2-29),  we  get 


ln[ 2  exp ( -  Xy^) ]  + 


From  this,  we  obtain 


ufi*° 


In  3 


Ufl=1 


For  the  case  when  u. 


U«  A 

yi  i  ,  0  -  h 

Ufl-i 


“fl-1 

u£l=0 


0 


=  Vu2  =  1J 

=  0,  we  obtain  as  before 

(u2  =  0) 


(2 -  30] 


(2-3i; 


(2-32; 


Similarly  for  detector  2,  we  obtain  the  following  likeli¬ 
hood  ratio  test 


=  t2(ux  =  1)  (2-33 

0  "  t2(ul  =  0)  (2-34 

Note  that  in  the  case  of  distributed  data  fusion  configu¬ 
ration,  we  need  to  have  the  actual  value  of  the  received 
data  {y ± }  before  we  can  make  a  final  decision.  Further¬ 
more,  the  final  decision  depends  on  the  value  of  the  re¬ 
ceived  local  decisions  {u,.}.  Basically,  D1  waits  for  the 


u£2  0 


y2  $ 


U{2  1 


and 


uf  2  =  0 

y  2  %  . 

uf  2  1 


3  0 


local  decision  u2  from  D2,  then  DF1  makes  a  final  decision 
based  on  the  value  of  u2  and  the  raw  data  y^ .  The  ROC  curve 
for  this  example  is  shown  in  Figure  2.6.  As  expected,  the 
performance  of  a  distributed  data  fusion  configuration  is 
superior  to  its  counterpart  -  the  centralized  data  fusion 
configuration. 


2.4.  Discussion 

In  this  chapter,  we  have  considered  the  design  of 
optimum  data  fusion  algorithms  for  the  signal  detection 
problem  when  multiple  sensors  are  used  for  surveillance  and 
a  global  decision  is  desired.  We  have  considered  two 
approaches  to  the  data  fusion  problem.  In  the  first  approach, 
a  centralized  optimum  data  fusion  structure  has  been  de¬ 
rived  which  combines  the  decisions  from  the  individual  de¬ 
cision  makers  while  minimizing  the  overall  risk  function. 
Individual  decisions  are  weighted  according  to  their  relia¬ 
bility,  i.e.,  the  weights  are  a  function  of  the  probability 
of  miss  and  the  probability  of  false  alarm  of  the  individual 
decision  makers.  In  the  second  approach,  an  optimum  distri¬ 
buted  data  fusion  structure  has  been  derived  which  combines 
the  decisions  from  other  decision  makers  and  the  raw  obser¬ 
vation  at  that  site  while  minimizing  the  risk  function  at 
that  site.  This  approach  gives  a  better  performance  than 
the  first  approach  since  we  are  using  the  actual  observation 
y^  instead  of  its  quantized  value  u^.  If  we  use  the  hard 
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decision  at  the  fusion  site  i  in  the  distributed  con¬ 

figuration,  we  will  obtain  the  same  performance  as  in  the 
centralized  configuration.  In  the  distributed  configura¬ 
tion,  we  have  a  global  decision  (fused  result)  at  each  site 

which  makes  the  system  more  survivable  for  military  appli¬ 
cations.  This  is  achieved  at  the  expense  of  added  communi¬ 
cation  amongst  the  sensors.  In  the  next  two  chapters,  we 
will  study  the  overall  problem  of  distributed  detection 
using  a  distributed  data  fusion  structure. 
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CHAPTER  THREE 

DISTRIBUTED  BAYESIAN  HYPOTHESIS  TESTING 
WITH  DISTRIBUTED  DATA  FUSION 

3.1.  Introduction 

Some  recent  work  on  the  Bayesian  detection  problem 
with  multiple  sensors  has  been  reported  in  the  literature. 
Tenney  and  Sandell  [2]  extended  the  classical  Bayesian  de¬ 
cision  theory  to  the  case  of  distributed  sensors  without  a 
data  fusion  center.  Ekchian  and  Tenney  [5]  then  formu¬ 
lated  and  solved  the  Bayesian  hypothesis  testing  prob¬ 
lem  for  various  distributed  sensor  network  topologies. 
Hoballah  [15]  considered  the  problem  of  distributed 
Bayesian  hypothesis  testing  using  a  centralized  data  fusion 
center.  In  this  chapter,  we  solve  the  problem  of  distri¬ 
buted  Bayesian  hypothesis  testing  with  distributed  data 
fusion.  In  Section  3,2,  we  formulate  and  solve  the  distri¬ 
buted  Bayesian  hypothesis  testing  problem  with  distributed 
data  fusion  for  the  case  of  N  decision  makers.  In  Section 
3.3,  we  present  the  results  for  the  case  of  two  decision 
makers,  and  illustrate  with  an  example.  Finally,  in 
Section  3.4,  we  discuss  the  results  obtained  in  this 
chapter . 
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3.2.  Distributed  Bayesian  Hypothesis  Testing  with 


Distributed  Data  Fusion 

In  this  section,  we  consider  the  system  as  shown  in 
Figure  3.1.  The  Binary  hypothesis  testing  problem  is  con¬ 
sidered  and  the  two  possible  hypotheses  are  denoted  by  Hq 
and  H^,  with  given  a  priori  probabilities  P(H^)  =  P  , 
j  =  0 , 1 .  The  ith  decision  maker, DM^,  consists  of  two  elements  - 

a  detector  D.  and  a  data  fusion  center  DF.,as  shown  in 
i  i’ 

Figure  3.2.  The  decision  maker  i,  DNT  ,  takes  an  observa¬ 
tion  y.,  i=l,...,N,  based  on  which  the  detector  i,  D^,  makes 
a  set  of  decisions  (uu,  ui2,...,  u^^,  u..  +  1,...,  uiN) 
where  u^.  represents  the  decision  made  by  D^  and  intended 
for  DF . .  We  will  denote,  by  u.  ,  this  decision  vector  genera- 

j  it 

ted  at  D^.  As  we  will  see  subsequently,  D.  employs  a 

different  decision  rule  while  determining  the  different 

elements  of  u^.  Each  data  fusion  center  j,  DFj  ,  receives 

a  decision  vector  (u. .  u-.,...,u.  , ■ ,  u.  ,.,...,u„.)  de- 

lj  2j  j'lj  j  + 1  j  Nj 

noted  by  u.  .  The  decision  vectors  u.^  and  u.  are  trans- 
ported  over  a  communication  network  which  is  responsible 
for  all  the  processing  necessary  for  transmission  to  the 
appropriate  DM's.  For  illustration,  we  show  an  explicit 
signalling  configuration  for  a  three  decision  maker  network 
in  Figure  3.3.  In  the  above  network  each  DM  receives  a  de¬ 
cision  vector  of  length  two  and  transmits  a  decision  vec¬ 
tor  of  length  two.  In  this  case,  the  vector  u^r  consists 
of  two  e  lement  s ,  e  .  g .  ,  -  lu^2,  u^},  an<^  t^ie  vector 

3S 


also  consists  of  two  elements,  e.g.,  -  (u2i>  u23^*  We 

further  assume  that  all  u^  e  {0,1},  i=l,...,N,j=l,...,N. 
The  final  decision  of  DNL  at  the  site  i,  i=l,...,N,is  de¬ 
noted  by  u^. 

The  aim  in  this  chapter  is  to  find  the  optimal  de¬ 
cision  and  fusion  rules  at  each  site  so  as  to  minimize  the 
expected  value  of  the  overall  cost  at  each  site.  The  prob¬ 
lem  can  be  formulated  as  follows.  Consider  the  system  con¬ 
figuration  shown  in  Figure  3.1. 


(A.l)  DNL  takes  an  observation  y^,  i=l,...,N. 

We  assume  that  (y^,  i*l,...,N)  are 
conditionally  independent  random  variables 
given  the  hypothesis  H,  that  is, 


p(yx» • • • ,yN I H)  =  .n  p Cy± I h) 


(3-D 


(A. 2)  Based  on  its  observation  y^,  makes 

N- 1  local  decisions  u^.  ,  j  =  l, . . .  ,i-l,  i  +  1,  .  .  .  ,N, 
i  .  e  .  , 


(3-2) 


u.  .  =  y . . (y  . )  , 

ij  ij  7  xJ  * 


i=l , . . . , N  ;  j-1 , . . . ,N  ;  i  f  j  . 


The  decision  u^  is  an  intermediate  decision 
made  at  whose  purpose  is  to  help  DM^.  in 
making  its  final  decision  u^j . 
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(A. 3)  Based  on  y^  and  Hir»  DFi  makes  a  final 
decision  u^,  i=l,...,N  ,  i.e., 

u£i  *  Hir1  • 


(3-3) 


The  decision  u^  is  the  final  decision  of 
DNT  at  the  site  i. 

(A. 4)  The  cost  incurred  in  making  the  decision 
at  DMj  is  denoted  by  JCu^.,  H)  where  I 
is  the  true  hypothesis.  We  assume  that 


J(u£.  =  i ,  d (u^.  -  i  ,  H^) ,  k  f  i 


j  =  l, . . .  ,N  ;  i=0 , 1  ;  k=0,l  . 


C3-4) 


All  these  inequalities  are  reasonable  because 
they  imply  that  an  error  is  more  costly  than 
no  error. 

(A. 5)  Also,  we  assume  that 

ptUfi  -  oiH-r  .  ukl  -  o.  yi> 


>  p(ufi  -  0|uir,  uki  -  1,  yt) 


(3-5) 


i=l . N  ;  j=l,...,N  ;  i  ?  j  ;  k=l,...,N 


where 

u^  ^  u.  without  its  kth  element  u,  . . 
— lr  — lr  ki 
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It  is  a  reasonable  assumption  since  in  most  practical 
cases,  one  would  expect  that  the  probability  that  DKL 

will  declare  Hq  is  higher  when  DM^  sends  the  decision 
uki  =  0  as  opposed  to  u^  =  1. 

Under  (A.l)  through  (A. 5),  the  problem  is  to  obtain 
the  optimum  strategies  y^,  Yji*  i= 1 > • • ■ >N> j =1 > • • • ,N,  i  t  j» 
so  as  to 


Minimize  E { J (yfi Cyi , y. a ,  j=l,...,N,  j  f  i),  H)  } 


Yi  e  r 


for  i=l , . . . ,N 


(PI)  J 


subject  to  (A.l)  -  (A, 5)  , 
where 

Yi  “  (y£i »  Y;ji  ,  3  =  1,2 . N,  j  f  i) 

and 


V  T  =  Set  of  all  possible  decision  rules 


(3-6) 


The  solution  to  the  problem  (PI)  is  given  by  the  following 
theorem  . 


Theorem  3.1 

The  optimal  decision  rules  associated  with  DM^ , 

i=l,...,N,  are  as  follows. 

At  the  detector  i,  D.,  the  decision  rules  y.., 

*i  ij  * 

j  =  1 , -  - . ,  i-1,  i+l,...,N  are  given  by  the  likelihood  ratio 


u.  .  =  1 

13 

Cy > 

1  1  u.So 

13 


t . .  , 
13 


(3-7) 


A-  (y.)  - 

l  7  l 


P (Yi lHi) 


(3-8) 


i'"0J 


I  i  Po{P[ufjlHjr>uij'1.HoI-P[ufilHjr.uij"0'Ho]> 


ur.  u. 
fj  >~3  r 


t..  A 

13 


£  PO\jlHo)  J(“frHo) 

k?  j 


l  i  pitpI“fjl^r.uij-O.H1]-p[u£i|^rfuij-l,H1]} 
Ufj,Hjr 


(3-9) 


.  n  P(\j  lHx)  J(u£j  |Hj) 

lc  1 

k^i,j 


i=l,...,N  ;  j=l,...,  i~l,  i+l,...,N. 


At  the  data  fusion  center  i,  DF^,  the  decision  rule  y^, 
i=l,...,N,  is  given  by  the  likelihood  ratio  test 


Ufi=l 


A. (y . )  >  tr . (u.  ) 

i  ..  <  n  fi  — ir' 


(3-10) 


ufi’° 


where 
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u.  J 
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p(H)p(ufi ]u-r,  y.,  H) 


*  P(Hir»  llH)  *  J(ufi>  H)  dil 


(3-14) 


Summing  over  all  values  of  u^,  and  ignoring  constant  terms 
we  have 


H.u. 

lr 


j  p(H)  p(ufi=01uir,yi,H)  p(uir,y|H)  J(ufi  =  0,H) 

I 


*  l  f  p(H)  p(ufi-l|u  y  H)  p(u  Z|H)  J(uf,=l,H)  d*;  (3-15) 

Gathering  appropriate  terms  in  (3-15)  and  using  (3-3),  we 
have 


J  J  pCu£r°iHlr.  yp  •  i 

-ir  yi 


|  p(H)  p(Hir>  ZlH) 

I1 


[J(ufi=0,H)  -  J(uf.=l,H)l  dy 

where 

i  -  • ,y i-!*  yi+1 . yN) 

Expression  (3-10)  is  minimized  if 


(3-16) 

(3-17) 


p(u 


p(H)  p(uir>  }i|H)[J(ufi=0,  H)  -  J(ufi=l,  H)]  d^1  >  0 

I1 


otherwise 


(3-18) 
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Note  that  the  decision  rule  YjjCy^)  is  obtained 
by  minimizing  the  risk  function  associated  with  DNL.  In 
tuitively,  it  makes  sense,  since  the  decision  u  j  ^  is  an  inter¬ 
mediate  decision  that  helps  DNL  make  a  final  decision  u^.. 
None  of  the  thresholds  depend  upon  the  observation  vector 
Y_,  so  that  an  off-line  calculation  of  the  thresholds  is 
possible.  The  set  of  thresholds  associated  with  DNL, 

{tfi*  tji’  J  =  1»  2,  ...»  N,  j  jrf  i}  can  be  determined 

N- 1 

through  the  simultaneous  solution  of  2  +  N-l  nonlinear 

N- 1 

coupled  equations  in  2  +  N-l  unknowns.  It  is  important 

to  note  that  these  equations  are  necessary  conditions  (but 
not  sufficient)  which  must  be  satisfied  by  the  thresholds. 
They  define  locally  optimal  solutions,  each  must  be  checked 
to  assure  that  a  global  minimum  is  found.  In  the  next  sec¬ 
tion,  an  example  is  presented  for  illustration. 


3.3.  Example 

We  consider  a  binary  hypothesis  testing  problem  with 
two  decision  makers  DM^  and  DM2  as  shown  in  Figure  3.4.  We 
assume  that  there  are  two  hypotheses  H1  and  HQ,  where 
P(H^)  =  p,  and  P(Hq)  =  1-p.  We  choose  the  minimum  probability 
of  error  cost  function,  i.e.. 


h  mr  _  •  - 
>>>! 
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d(u£i  =  1,  Hj)  =  =  0,  H  )  =  0  and 

J(uf.  =  0,  Hx)  =  J (uf.  -  1,  Hq)  -  1  . 


(3-24) 
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Phenomenon  H 


Before  we  proceed  further,  we  state  the  results  of  Section 
3.2  for  the  case  of  N=2.  They  can  be  summarized  in  the 
following : 


Ufi-l 

a  .  (y . )  >  t r . (u . . ) 

11  utSo  fl  J1 
f  1 


(3-25) 


for  i=l , 2 ,  j=l,2  ,  j  ?  i  , 


where 


,  p  (H  )  p  (u .  .  | H  )  [J(u  =1,  H  )  -  J(u..=0,  H  )] 
*.  c,  i  A  o  F  ]r  o  L  fi  *  o  fi  ’  o  1 

fiL  FTH7I  p(Uj  .  jH^  tJ(uf.=0,  H1)-J(ufi  =  l,  Hx)] 


The  decision  rule  y.^(*)  is  given  by 


u.  .  =  1 
J  1 

A  (y.)  >  t  for  j-1,2  , 

J  -  u .  .  =0  J1 

J  1 


where 


l  P(H0)[p(ufi|u  =1,  Hq)  -  p(ufi|u  =0,  H  )]J(uf  H  ) 

^fi _ _ _ _ _ 

l  pfH^tpfu^lu  =0,  Hl)  -  p(ufi|u  =1, 


(3-26) 


(3-27) 


for  i=l, 2,  j=l,2,  i  t  j  . 


(3-28) 


The  optimal  decision  rules  associated  with  DNP  ,  i=l,2,are 
described  by  three  thresholds  at  the  site  i.  The  thresholds 
are  determined  by  solving  a  set  of  three  coupled  nonlinear 
equations  in  three  unknowns.  We  further  assume  that  the 
conditional  density  p(y.JlL)  are  exponential,  i.e., 


p(yi|HQ)  =  exp  (-  yi) 


pCYilHp)  =  X7  exp  (-  y£)  ;  X±  >  0,  i=l,2 

for  y.  >  0  and 

p(y^|H^)  =  0  ;  i-1,2  elsewhere 


(3-29) 


The  optimum  decision  rules  at  the  site  1  are  obtained  from 
equations  (3  -  2 5) -  (3  -  2 8) .  We  have  the  following  equations. 


p(yilHl)  i  i 

pi y.-nrr  =  ~  ex?  ^i(1  '  i=1>2- 


(3-30) 


The  thresholds  an<^  t2i  are  obtained  using  expres¬ 

sions  (3-26)  and  (3-28).  We  have 


p^i'V 


21 1  1 


(3-31) 


[p(u..  =  l  |u7.  =  l,  H  )  -  p(ufl  =  l  |u71  =  0 ,  H  )  ]  (1-p) 


Zi  lp(u£1=0 |u21=0,  H1)  -  p(ufl=0 |u21=l,  H1)Jp 

(3-32) 

We  can  evaluate  the  thresholds  using  the  probability  density 
functions  and  the  decision  rules.  Note  that  expressions 
(3-31)  and  (3-32)  are  coupled.  One  needs  to  solve  them 
simultaneously  in  order  to  obtain  a  solution.  Next,  we  ob¬ 
tain  the  error  probabilities  to  be  used  in  order  to  compute 
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the  thresholds. 


p(un-l|Ho)  .  f  P  |H  Cy2|H0)  dy2  (3-33) 

v  .  A  fy  )  >  t  ^  o 

y i'  2iy2J  -  21 


A.  >  1,  then 

l  * 


PCu2i=1lH0)  = 


(A2  t21) 


C  3  -  34) 


P  ( u2 1  1lHi^  (X2  t21'* 


C3-35) 


Furthermore,  one  needs  to  get  expressions  for  pfu^jj  u2  j,  H)  , 


we  have 


1_A1 

P  (uf  !=1  I  U21  ’  Ho^  ~  ^A1  tflf-u21')^ 


i_Al 

P  ^Uf 1-1 I U21 ’  ^1^  -  ^A1  1 ^U21^  ^ 


(3-36) 


(3-37) 
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Using  expressions  (3-31)  and  (3-32),  we  obtain  the  following 
coupled  equations 


*****  •*  ->  V.VT’^-Vr/ V,V_V_Vl.W>.’VT..V,W>»JV-V.V,T» 
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1  -  A. 


21 


1  -  p  ^Altfl(‘U21~Q)  ^ 


[Ai  tfi^u2i“1^ 


ll 


1 


[Aitfi  (u21=>  0)  ] 


1 

nr. 


[A 


1  "fi^zi-1^ 


i 
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tflCu21al)  = 


1  - 


X2t2 


(3-38) 


fl(u2l'0) 


,  1  -  (A.t^.) 

t„(u,,=o)  =  L.-JP. - UlL- 

p 

1  "  ^2*21^ 


2 

nr. 


1-  A, 


In  Figure  3-5,  we  present  the  ROC  curve  for  this  example. 


3. 4  Discussion 

In  this  chapter,  we  have  considered  the  problem  of 

distributed  Bayesian  hypothesis  testing  with  distributed 

data  fusion.  We  have  derived  the  optimal  decision  rules 

for  the  system.  Due  to  the  independence  assumption,  the 

decision  rules  are  likelihood  ratio  tests  (LRT) .  At  each 

N- 1 

site,  we  obtain  2  +N-1  coupled  nonlinear  equations.  The 

N  - 1 

simultaneous  solution  of  these  equtions  yield  the  2  +N-1 

thresholds.  These  are  necessary  equations  which  must  be 
satisfied  by  all  of  the  thresholds.  There  may  be  several 
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Probability  of  Detection 


C.  00  2.  cj0  5.  00  7.  50 

(XI  O'1)  Probability  of  False  Alarm 


10.  00 


Figure  3.5.  Receiver  Operating  Characteristic  for 
A  ^  =  2  ,  A  2  =  1 • 5  . 
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CHAPTER  FOUR 


DISTRIBUTED  NEYMAN- PEARSON  HYPOTHESIS 
TESTING  WITH  DATA  FUSION 

4.1.  Introduction 

In  Bayesian  hypothesis  testing,  knowledge  of  the 
a  priori  probabilities  and  a  cost  assignment  is  required. 

In  many  practical  situations,  it  is  difficult  to  assign 
realistic  costs  or  a  priori  probabilities  may  not  be  known. 
An  approach  to  bypass  this  difficulty  is  to  use  the  Neyman- 
Pearson  (N-P)  test.  In  this  approach,  the  knowledge  of 
a  priori  probabilities  and  a  cost  assignment  is  not  required 
and,  therefore,  it  has  many  practical  applications.  In  the 
N-P  detection  problem,  we  maximize  the  probability  of  de¬ 
tection  under  a  constraint  on  the  probability  of  false- 
alarm. 

In  this  chapter,  we  solve  the  problem  of  distributed 
hypothesis  testing  with  data  fusion  using  the  Neyman- 
Pearson  approach  for  various  distributed  sensor  network 
(DSN)  topologies.  The  problem  of  distributed  hypothesis 
testing  with  a  centralized  data  fusion  using  the  Neyman-Pear 
son  approach  has  been  solved  by  Hoballah  [15]. In  Section  4.2, 
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we  solve  the  Neyman  -  Pearson  hypothesis  testing  problem 


with  data  fusion  for  a  specific  two-sensor  system.  In 


Section  4.3,  these  results  are  extended  to  solve  the  problem 


of  distributed  Neyman-Pearson  hypothesis  testing  with  dis¬ 


tributed  data  fusion.  In  Section  4.4,  the  results  of 


Section  4.2  are  further  extended  to  solve  the  distributed 


Neyman-Pearson  hypothesis  testing  problem  for  N  detectors 


connected  in  tandem.  In  Section  4.5,  we  present  an  example 


for  illustration. 


4.2.  A  Distributed  Neyman-Pearson  Hypothesis  Testing 
Problem  with  Two  Decision  Makers 


In  this  section,  we  consider  the  system  configuration 


as  shown  in  Figure  4.1  .  The  two  possible  hypotheses,  are 


denoted  by  Hq  or  H^.  Each  decision  maker  i,  DM^ ,  takes  an 
observation  y^,  i=l,2.  Based  on  y  ,  DM^  makes  a  decision 
u-^  e  {0,1}  which  corresponds  to  the  hypotheses  Hq  or  H^. 
The  decision  u^  is  transmitted  to  DM2>  Then,  based  on  u^ 
and  y2,  DM2  makes  a  final  decision  u^.  The  joint  proba¬ 
bility  density  function  p  (y  ^  » y  2  I assumed  to  be  known 


a  priori.  The  aim  is  to  find  the  optimal  decision  rule  at 


DM^  and  the  fusion  rule  at  DM2  using  the  Neyman-Pearson 
approach,  i.e.,  we  maximize  the  overall  probability  of 
detection,  Pr[u^2  =  1|H^],  given  a  constraint  on  the  overall 
probability  of  false  alarm,  Pr[u^2  =  1|Hq]. 

The  problem  is  formulated  as  follows: 
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(A.l)  Let  {y£1  i»l,2}  be  a  set  of  conditionally 
independent  random  variables  given  the  hypo¬ 
thesis  H. 

(A. 2)  The  decision  maker  2  makes  a  decision 
u^2  where 

uf 2  =  Yf2*-y2’  ul-* 

(A.  3)  The  decision  maker  1  makes  a  decision  u^ 


(4-1) 


where 


ui  ' 


(4-2) 


Under  (A.l) -(A. 3),  the  distributed  binary  N-P 
hypothesis  testing  problem  can  be  stated  as  follows: 

Find  the  decision  rules  yC2(*)  and  y^C-) 
so  as  to  minimize 

F  =  Pr[uf2=0|H1]  +  A  (Pr[uf2=l |Hq]  -  a) 

(P2)  / 

|  under  the  constraint  that 

1  Pr [u£2«l |Hq]  =  a'  <  a 
I  where 

V  X  -  the  Lagrange  multiplier  . 

The  solution  of  problem  (P2)  is  given  by  the 
following  theorem: 


(4-3) 


(4-4) 
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Proof : 


The  decision  rule  at  DM2  is  obtained  as  follows.  The 
objective  is  to  minimize  F  where 


F  =  Pr[uf2=0|H1]  +  A(Pr [uf2=l |Hq]  -  a)  (4-11) 


Equation  (4-11)  leads  to  the  classical  Neyman-Pearson  test 
where  the  observations  are  (y2,  u^}.  In  other  words,  we 
obtain  the  following  test  [1], 


p(u1,y2|H1)  uf 2=1 

p(ui  '•y2\wo1  uf  2=0 


(4-12) 


Using  the  independence  assumption  (A.l),  we  have 

p(yzlHi)  uf  2~ 1  P(uilH0) 

—r  n~T  >  A  r  ±  T m-P-t  .  (4-13) 

PW  uf  2_  0  PCU1  lHiJ 

One  needs  to  find  an  expression  for  the  Lagrange  multiplier 
A  to  completely  define  the  decision  rule  y^t*)*  Since 
the  probability  of  false  alarm  Pr  [u^2=  1  | F{q  ]  _<  a,  let  us 
choose 


Pr[Uf2=l|H0]  =  u 1  <_  a 


(4-14) 


0  0 


P (uf  7  1 


iv^)  -{ 


1  l£  ^2  ^2  -  tf2(‘Ul') 


(4-20) 


0  otherwise  , 


equation  (4-15)  becomes 


P(u£2=l |Hq)  =  a'  =  I 


1  y2:A2(-)ltf2(u1) 


p(y2lH0)  P^u! |hq)  dy2 


(4-21) 


which  completes  the  proof  of  Theorem  4-l(a).  Q.E.D. 

The  decision  rule  at  the  decision  maker  1  is  obtained 
as  follows.  Starting  with  expression  (4-11),  we  have 


F  =  Pr[uf2=0jH1]  +  X(Pr[uf2=l|Ho]  -  a) 


(4-22) 


Using  (4-15)  in  (4-22),  we  have 


F  =  l  p(uf2=0|u1,  Hx)  p(u1|H1) 


+  X  (£  p(uf2=l|u1,  Hq)  p  ( u  x  1 H  o )  -a) 


(4-23) 


Expanding  the  above  expression  with  respect  to  u^,  we  have 


F  P  CU1  0  1 11 !  ■'  (D0|0,l  "  Do  1 1 ,  I  }  *  Do  1 1 , 1 


+  X[p(u1=l|Ho)(D1|li0  -  D1|o>0)  *  D1|o>0  -  a)  (4-24) 


where 


Pr[u1=l|Ho]  = 


(4-29) 


j  P^i!H0)  dXi 

y  i^iCyi^i 

which  completes  the  proof  of  Theorem  4-l(b).  Q.E.D. 

In  the  next  two  sections,  we  generalize  the  results 
of  this  section  in  two  different  directions.  First,  wj 
formulate  and  solve  the  distributed  detection  problem  with 
distributed  data  fusion  centers.  Then  we  solve  the  problem 
of  tandem  topology  distributed  network  for  N  decision 
makers . 

4.3.  Distributed  Neyman- Pearson  Hypothesis  Testing  with 
Distributed  Data  Fusion 

In  this  section,  we  consider  the  system  configuration 
as  shown  in  Figure  4.2.  The  signalling  scheme  for  distri¬ 
buted  data  fusion  has  already  been  described  in  Chapter  3. 
In  that  chapter,  we  solved  the  distributed  Bayesian  hypo¬ 
thesis  testing  problem  with  distributed  data  fusion.  In 
this  section,  we  solve  the  distributed  Neyman- Pear son 
hypothesis  testing  problem  with  distributed  data  fusion. 

The  aim  here  is  to  find  all  of  the  optimal  decision  rules 
at  each  site  i,i=l,...,N.  At  the  site  i  ;  the  objective  is 
to  maximize  the  probability  of  detection  Pr  [  u^  =  1  |  ]  , 

given  a  constraint  on  the  probability  of  false  alarm 
Pr[Uf.=l|H  ].  '.Ve  formulate  the  problem  as  follows: 


.-'re  T.i(Ty.T."-v  w  •\~-r.'vr.''-rrs.- 


(A.4)  Let  {y^,  i=l,...,N}  be  a  set  of  independent 
random  variable  given  the  hypothesis  H. 

(A. 5)  At  each  site  i,  the  decision  maker  i  makes  a 
set  of  intermediate  decisions  where 

-it  =  ui i - 1  »  uii  +  l’ - * uiN^ 


u.  .  =  y- - (y •  ) 
ij  ij  7  1 


(A. 6)  At  each  site  i,  the  decision  maker  i  makes  a 
final  decision 


where 


ur-  =  Yr  •  (y  •  »  u .  ) 

fi  fi  7i’  — ir7 


Yf^(*)  is  the  final  decision  rule  at  the 
site  i,  i=l, . . . ,N, 


u.  is  the  received  decision  vector  from  the 
— lr 

other  decision  makers, 


a  , 

— lr  li’  *  i-I  i’  i  +  I  i’  ’  Ni7 


(4-30) 


(4-31) 


(4-32) 


(4-33) 


Under  (A. 4)  -  (A. 6),  the  distributed  binary  N-] 
hypothesis  testing  problem  can  be  stated  as  follows: 


■YVV'V 

&#■>; 

M*  V  VJ  > 


V.V.A 

V  V  V  * 

»  '»  v  v 

V.-.-V" 

V  vV 

I-'  ,".  V. 
v  ■ 

^v‘v- 

V  *  *  ■  v 


W*  V 

y  a  v\  V.j 


/  ,  •  ,  '  .  '  .  *  . 
v.v.v,\  v 

yv.  v;.  y.  •;/,  , 


*'»  •*..  •*,  ■*.  **« 


& 

.\-Yvj 

• 

t  ’V 

..Nv-' 

.  y.V,  »" 
V  V 

✓  V 
■  . 1 

• 

IP 

»  h»  w 

"w  %  *V  1 

*  V  v  V 
*v  v  %V 

jSg 

+  vV> 

,VAAA 


>\W 
Y-VvS^V->» 
• > 

vlvif v!  W,7 7  \ 


At  eachDM^,£ind  the  decision  rules  Yj^(*)> 
andYf^(*),  i,j  =  l,...,N,  i  f  j  so  as  to  minimize 


>#£3 


Fi  -  Pr[ufi=0|H1]  +  X.(Pr[uf.=l|Ho]  -  a.)  (4-34) 


under  the  constraint  that 


Pr  [ufi=l |Hq3  <  a.  , 


(4-35) 


'  A^  -  the  Lagrange  multiplier  at  the  site  i. 

The  solution  of  problem  (P3)  is  given  by  the  follow¬ 


ing  theorem: 


Theorem  4.2 


For  the  distributed  detection  system  shown  in 
Fig.  4.2,  the  optimal  decision  rules  using  the  Neyman- 
Pearson  approach  are  given  as  follows: 

(a)  The  optimum  decision  rule  Y^C*)  at  the  site  i, 
i=l,...,N,  is  described  by  the  LRT. 


where 
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p(ufi=i|H0)  =  a' 


I  J  p(yt!Ho)-  n  p(uji|Hoj  dy . 

Hir  yi:Afi(-)>tfi  H) 


(4-38) 


(b)  The  optimum  decision  rule  Yki(*),  k=l , 2 , . . . , i - 1 , 
i+l,...,N;  at  the  detector  k  is  given  by  the  LRT 


Ak(>'k)  = 


p(yklH1)  Uki  1 

— ?  I  If  "k-  > 


kl  0  uki=0 


i  > 


(4-39) 


where 
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The  strategy  at  the  data  fusion  center  1  of  DNL  is  ob¬ 
tained  first.  The  objective  is  to  minimize  Pr[u^  =  0 1 ] 
under  a  constraint  on  the  probability  of  false  alarm, 

i.e.,  Pr[ur.  =  1|H  ]  =  a-'  <  a- .  Let  us  define  F.  as 
ti  oil  1 


Fi  =  Pr[ufi  =  0|H1]  +  xi  [Pr[ufi=l  |Hq]  -  a-.]  . 


(4-42) 


The  minimization  of  F^  leads  to  the  classical  Neyman- 
Pearson  test  where  the  observations  are  (y^,  u j i >  j*l>  2, . . .  ,N, 
j  f  i}.  In  other  words,  we  will  obtain  the  following  test  [1] 


A  p(yi’  Hir^i)  Ufi  1 

V#  '  p  (y  - ,  ..  ■  |HT  ?  „ 

— ir  1  o  uf^  =  0 


Using  the  independence  assumption  (A. 4),  we  have 


(4-43) 


P  Cy± [H1)  p(u-r|H1)  Ufi  1 

P(yilHo)  PCHirlho}  ufSo  Ai  ’ 


(4-44) 


p Cy± lHx3  ufi  1 

p  (y  Tim  <  n 

K  w  l  1  o  u  , .  =0 
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N  P(uu|H0) 

j-1  Pl-ji'IV 


(4-45) 


One  needs  to  find  an  expression  for  the  Lagrange  multiplier 

#  in  order  to  completely  define  the  decision  rule  y^C*). 

Since  the  probability  of  false  alarm  Pr[u^.^=l|Ho]  £  cu  , 

we  choose  Pr[ur.=l|H  ]  =  a!  <  a.. 

L  f  l  1  o 1  1  —  1 
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Using  the  theorem  of  total  probability,  we  have 


pCifi-iliy  -  l  P(ufl“l|uir,  Ho)  p(uir|H0)  ■  (4-46) 


Hir 


Using  the  assumption  that  depends  only  on  y^  ,  (4-46) 

reduces  to 


N 


where 


I  pCUfi-ilHi  ,  H  )  n  pCu  ]H  5 

U .  1  =  1  J 


(4-47) 


p(u,-.  =  llu.  ,  H  )  =  p(u£.=l|u.  ,y.)  p(y.|H  )dy.  . 

v  fi  ir*  o  K  fi  '-ir’;i  o'  7i 

Yi  (4-48) 

The  probability  p(u^^=l|u^r>  y ^ )  e  {0,1}  depending  on  the 
values  of  {u.  ,  y.}  which  is  the  set  of  observations  that 
the  data  fusion  center  i  receives.  Following  the  steps  in 
equation  (4-19)  and  (4- 20),  equation  (4-48)  can  be  written 


as 


pCUfi'ilHir. 


H  )  = 
o 


p(Yi lH0)  dYi  •  C4'49) 


y  i  :  Af  i  ( ' )  — t"  f  i  ^ 

Then  substituting  (4-49)  in  (4-47),  we  get  (4.38),  and  this 
completes  the  proof  of  Theorem  4.2(a). 

The  decision  rule  y j ^ ( * )  for  the  decision  maker  j  for 
j  =  l,...,i-l,  i  +  1 , . . . ,N  .associated  with  the  function  is 
derived  next.  Substituting  (4-46)  into  (4-42),  we  obtain 
the  expression  for  F-  to  be 
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Fi  =  l  P(ufi*°!Hi-  Hlrj  Ptulr |Hj) 
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Expanding  (4-50)  in  terms  of  u,  . ,  we  have 

K 1 
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We  can  write  (4-51)  as 


Fl  '  pCuki=° tHi3  Dol  *  col 
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The  minimization  of  (4-57)  yields  the  following  result 


Ak(^lP  = 


A  P^kiHl3  Uki  =  1 


k'n0J  u.  No 

ki 


(4-58) 


where  t^  is  given  by  equation  (4-40)  and  p(u^=l|Ho)  is 
given  by  equation  (4-41).  This  completes  the  proof  of 
Theorem  4-2.  Q.E.D. 

In  the  next  section,  we  formulate  and  solve  the  prob 
lem  of  distributed  Neyman- Pearson  hypothesis  testing  in  a 
tandem  topology  network  consisting  of  N  decision  makers. 


4.4.  Distributed  Neyman-Pearson  Hypothesis  Testing  in  a 
Tandem  Topology  Network 

In  this  section,  we  consider  the  system  configuration 
as  shown  in  Figure  4.3.  We  solve  the  distributed  Neyman-Pea 
son  detection  problem  for  an  N-decision  maker  tandem 
topology.  The  distributed  detection  network  can  be  viewed 
as  a  team  of  decision  makers,  where  each  decision  maker 
receives  a  conditionally  independent  observation  given  the 
hypothesis  H.  The  team  of  DM's  desire  to  maximize  the 
probability  of  detection  Pr[u^=l|H^]  of  the  last  decision 
maker,  DM^ ,  under  a  constraint  on  the  probability  of  false 
alarm  Pr[uM=l[H  ]  of  DM 

We  formulate  the  problem  as  follows: 

(A. 7)  Let  {yi,  i=l,...,N)  be  a  set  of  conditionally 
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Fig.  4.3,  the  optimal  decision  rules  using  the  Neyman- 
Pearson  approach  are  given  as  follows: 


(a)  The  optimum  decision  rule  A^(*)  at  the  site  N,  is 
described  by  the  LRT 


A  P^N^l'  “N=1 


AnC>,n>  '  P(yN|Hoj  u?=0 


Vvd 


(4-62) 


where 


and 


t  ru  )  A  x  P[UN-1 
NtuN-lJ  XN  ^“"ITTp- 


(4-63) 


p(uN=1lH0)  = 


u 


p(yNlHo}  dyN  P(uN-llHo)  f4'64) 


N 


(b)  The  optimum  decision  rule  y^(»)  at  the  site  i, 
i= 2 , 3 , . . . , N- 1 ,  is  described  by  the  LRT 

.  Pf/ilH,)  Ui_1 

Vyi>  ■  pF7TTrru?,0  Wi>  -  (4'65) 

i 

where 

p(»1-1|H„)[p(uN-i[ui-i,no)  -  PlyilyM^l 
i  i  -  1  N  p-(ui_1  IHjJl  p  CuN=0  |uT  =  0  ,H1)  -  p  (uN=0  |  u^l  .Hj.)  ] 

(4-66) 

and 
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(4-71) 


The  minimization  of  (4-71)  leads  to  the  classical  N'eyman- 
Pearson  test  where  the  observation  set  for  DM^T  is  {y^,u^_^}. 
In  other  words,  we  will  obtain  the  following  test  [1]. 


PfyN’  UN-  1  1  H1 }  Uf 1  X 

p(yN,  vUV  “n*0 


Using  the  independence  assumption,  we  have 


p(yN!HP  UfJ  1  p  Cun-  i  lHoJ 

FtTPy  u!-o  an  FTViW 


(4-72) 


(4-73) 


One  needs  to  find  an  expression  for  the  Lagrange  multipier 
in  order  to  completely  define  the  decision  rule  y^(»). 
We  choose  Pr[u^=l;H  ]  =  u,t  £  a^,  and  we  have 


p[uN=l|HQ]  =  =  l  p(uN=l,  uN.1|H  )  (4-74) 

UN  -  1 

Using  the  theorem  of  total  p robab i  1  i ty,  we  have 


Pr [ u  = 1  ;  H 
1  \  o 


P  (uN=  1  I  UN- i  »H0) 


N  -  1 


(4-75) 


and,  as  before  we  obtain 
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This  completes  the  proof 
The  decision  rule 
next.  We  start  with  the 


of  Theorem  4.3(a) . 

Yi ( •) ,  i=  2, 3, . . . ,N- 1, 

function  F... 

N  ’ 


is  obtained 


^r^uN  9l^l^  T  Aj\j  -M  1  "  aN^  *  (4*77) 

Expanding  the  probability  f  miss  and  false  alarm  with 
respect  to  u_^ ,  we  have 

FN  =  l  P(uN=0>ui lHi^  +  AN  (I  P(uN=1»Ui lHo}  '  aN]  *  (4~78) 

i  Ui 

Using  Bayes  rule,  we  obtain 


FN  =  I  p(uN=0|u.,H1)  p(u.|H1) 
ui 

+  AN[£  PtuN=1lui>H0)  P(uilH0}  '  aN]  •  (4’79) 

i 

Gathering  similar  terms  and  ignoring  constant  terms,  we 
have 

Fn  =  p(ui-0|H1)  Dol 

*  >-N[p(ui-l|H0)  D1q  *  Cl0  -  aNl  ,  (4-80) 

where 

Doi  -  P (UN=0 I ui  =  0  jHj )  -  p(uN=0|ui  =  l,H1)  ,  (4-81) 


(4-82 


Dlo  “  P(uN=l|ui=1’Ho}  '  P  ^UN= 1  I ui  =  0  ,Ho^ 

and 

Clo  =  PCuN=1lui=0»Ho3  •  (4‘83) 

Writing  (4-80)  in  the  same  form  as  (4-11),  we  have 

Fn  -  plUj-OlHj)  *  Vr  (P^i*1  I  "o’  -  ■ 

ol  lo 

(4-84) 

The  minimization  of  expression  (4-84)  yields  the  follow¬ 
ing  LRT, 
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Using  the  fact  that  y^  does  not  depend  on  u._p  we  have 
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and 


P(ui=l|Ho)  = 
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P  Cy± | Ho)  p(u._1|Ho)  dy t  (4-87: 
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which  completes  the  proof  of  Theorem  4- 3(b). 

The  decision  rule  Y^(*)  is  obtained  as  follows. 
Using  the  function  F^,  we  have 


SO 


(4-88) 


-  Pr[u^  0|H^]  +  [Pr [u^- 1 | Hq ]  -  a^J 
Expanding  F^,  with  respect  to  u-^,  we  have 

FN  =  ^  P(uN=0>uiIHi)  +  XNH  P(un=1>u1  li:0)  '  aN] 
U1  U1  c 

Using  the  total  probability  theorem,  we  have 


Fn  =  l  P(uN=0  |u1,H1)  pCu-j^lH-j^) 
u. 
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J]  (4-90) 


Gathering  similar  terms  and  ignoring  constant  terms,  we 
have 
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where 
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(4-91) 

(4-92) 
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and 

Bio  =  P(uN*1lul’°>Ho)  '  (4-96) 

The  minimization  of  expression  (4-91)  yields  the  follow¬ 
ing  LRT, 
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The  decision  rule  is  given  by 
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which  is  equivalent  to 
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(4-104) 


The  probability  of  false  alarm  and  the  probability  of  miss 
for  the  two  detectors  are  given  by 


P„.  =  (0. t . )  1  =  exp (-  t! ) 

Fi  li  r  l 


(4-105) 


and, 
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(4-106) 


From  (4-6)  and  (4-9),  the  two  thresholds  satisfy  the 
following  set  of  equations 

_ _ p(ur1|Ho)  .  ,  pF, 
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In  this  chapter,  we  have  considered  the  problem  of 
distributed  Neyman-Pearson  hypothesis  testing  for  two  dif¬ 
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ferent  topologies.  First,  we  solved  the  problem  of  dis¬ 
tributed  hypothesis  testing  with  distributed  data  fusion. 
Then,  we  solved  the  problem  of  distributed  detection  for 
an  N-decision  maker  tandem  topology.  In  both  cases,  we 
derived  the  optimum  decision  rules  for  each  decision  maker. 
We  have  shown  that  the  threshold  equations  are  coupled. 

One  needs  to  solve  these  equations  simultaneously  in  order 
to  obtain  a  solution  for  the  thresholds.  There  may  be 
several  solutions  for  these  coupled  nonlinear  equations. 
Each  solution  must  be  checked  to  assure  that  the  global 

solution  is  found.  We  have  also  shown  that  the  decision 
rules  are  likelihood  ratio  tests,  this  is  due  to  the  inde¬ 
pendence  assumption.  The  present  analysis  can  be  extended 
in  many  directions.  For  instance,  the  case  of  M-ary  hypo¬ 
thesis  testing  with  N  decision  makers  can  be  considered. 

In  the  next  chapter,  we  consider  the  problem  of  distributed 
sequential  detection. 
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CHAPTER  FIVE 


DECENTRALIZED  SEQUENTIAL  HYPOTHESIS  TESTING 

5 . 1  Introduction 

The  decentralized  sequential  detection  problem  has 
received  some  recent  attention  [10,11].  In  [10],  Teneketzis 
considered  a  decentralized  version  of  the  Wald  problem  with 
two  decision  makers.  In  his  model,  each  detector  was  given 
the  flexibility  of  either  stopping  and  making  a  decision  or 
continuing  to  the  next  time  stage.  The  coupling  between  the 
two  detectors  was  introduced  through  a  common  cost  function. 
His  results  show  that  coupling  causes  considerable  complexity 
in  the  computation  of  the  optimal  stopping  rules.  In  [11], 
Hashemipour  and  Rhodes  examined  a  two-step,  two -detector , 
hypothes is  -  test ing  problem  with  a  data  fusion  center.  They 
also  discussed  its  straightforward  extension  to  a  decentra¬ 
lized  multi-stage  sequential  detection  problem.  Their  model 
is  different  f~om  the  one  examined  in  [10].  In  [11],  the 
sequential  test  is  performed  at  the  data  fusion  center  and 
local  detectors  have  no  control  over  the  termination  of  the 
test . 

Here,  wc  make  some  further  contributions  in  the  area 
of  distributed  sequential  hypothesis  testing.  First,  we 
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solve  the  distributed  sequential  detection  problem  for  a 
tandem  topology.  This  is  a  multi-stage  extension  of  the 
work  of  Ekchian  and  Tenney  [5].  Then,  we  solve  the  sequen¬ 
tial  probability  ratio  test  problem  for  the  same  model  as 
in  [11]. Here,  however,  we  use  the  Neyman-Pearson  approach 
for  the  solution  of  the  problem. 

In  Section  5.2,  we  briefly  discuss  the  centralized  Wald 
problem.  The  results  are  used  in  Section  5.3.  In  Section 
5.3,  we  formulate  and  solve  the  decentralized  Wald  problem 
for  a  tandem  topology  network.  In  Section  5.4,  we  formulate 
and  derive  the  decision  rules  for  the  decentralized  sequen¬ 
tial  probability  ratio  test.  Finally,  in  Section  5.5  we 
discuss  the  results  of  this  chapter. 

5.2.  The  Centralized  Wald  Problem 

In  this  section,  we  present  briefly  the  centralized 
Wald  Problem  and  its  solution.  The  Wald  Problem  is  a  well 
known  problem  in  statistical  sequential  analysis  [13,18]. 

It  can  be  formulated  as  follows: 

(A.l)  Consider  two  hypotheses  { H  ,  H^}  where  the  a  priori 
probability  of  II  is  given  by 

Prob[HQ]  =  PQ  .  (5-1) 


(A. 2)  Consider  a  detector  whose  observation  at  time  t 
is  denoted  by  y  .  Let  (yt;  t=l,2,...}  be  a  set 
of  independent  random  variables.  Based  on 

y1"  =  Cyx . y  )  ,  the  detector  makes  a  decision 

u  given  by 

U  =•  YCy1)  ,  U  e  {0,1}  (5-2) 


where  y(-)  is  the  decision  rule. 

(A. 3)  The  cost  of  making  a  decision  u  at  the  detector  is 
J(u,H),  where  H  is  the  true  hypothesis. 

(A. 4)  The  detector  must  make  a  decision  u  no  later 

than  t=N.  Then  the  Centralized  Wald  Problem  is  to 

Minimize  EfJCyCy1"),  H)  ] 


(P5) 


y  E 


Subject  to  (A.l)  -  (A. 4) 


(5-3) 


where 

\ 

T  =  Set  of  all  stopping  rules 

The  solution  to  problem  (P5)  is  given  in  [13].  It  can 
be  summarized  in  the  following  theorem: 


Theorem  5.1 

The  optimal  decision  rule  at  the  detector  is  de¬ 
scribed  by  (2N-1)  thresholds  >  •  •  •  , 

thresholds  can  be  obtained  from  the  following  equations 


At  t  =  k  (k=l , . . . ,N- 1 ) 


£ 


1 


if  p [Hq | yK]  <  ak  ,  decide  Hj, 


if  P  [Hq  !  y K]  _>  3k  ,  decide  Hq  , 


if  a,  <  p [H  | y  ]  <  Bv  ,  continue  to  take 


observations . 


(5-8) 


At  t  =  N 


if  P(HQ|yN)  1  5^n  >  decide  H( 


if  p(H  |y  )  <  >  decide  , 


(5-9) 


In  this  section, we  have  presented  the  centralized  version 


of  the  Wald  Problem  -  its  formulation  and  its  solution.  In 


the  next  section,  we  formulate  and  solve  the  decentralized 


Wald  Problem  for  a  tandem  topology  network. 


5.3.  The  Decentralized  Wald  Problem  for  a  Tandem 


Topology  Network 


Consider  the  tandem  topology  network  as  shown  in 


Figure  5.1.  It  consists  of  two  decision  makers  DM^  and  DM^ 


connected  in  series.  In  this  section,  we  formulate  and 


solve  the  decentralized  Wald  problem  for  the  system  shown 


in  Figure  5.1. 


The  problem  is  formulated  as  follows: 
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(A.  5)  Consider  two  hypotheses  {Hq,  }  where  the  a  priori 
probability  of  HQ  is  given  by 

Prob  [Hq]  =  PQ  •  (5-10) 

(A. 6)  The  decision  maker  1  makes  a  decision  ut  at  time  t 
given  by 

ut  =  Vxt).  ut  e  t0’  ’  C5'11) 

where  y  (•)  is  the  decision  rule  at  DM^ ,  and 

xt  =  )  represents  the  set  of  observations 

at  DM^  up  to  time  t. 

(A.  7)  Define  u*  =  (u^ , . . . ,ut)  where  is  the  decision 
of  decision  maker  1  at  time  t. 

(A.  8)  The  decision  maker  2  makes  a  decision  v^  at  time  t 
given  by 

vt  =  Yv(y*)  ,  vt  e  {0,  1)  (5-12) 

where  y  (•)  is  the  decision  rule  at  DM- ,  and 
yt  =  (y^,...,yt;  u^)  represents  the  set  of  obser¬ 
vations  at  DM2  up  to  time  t.  Note  that  y^  also 
contains  u^,  the  set  of  incoming  decisions  from 
DM1. 

(A. 9)  Define  v1"  =  (v^  ,  .  .  .  ,vt)  where  v^  is  the  decision  of 
DM ^  at  time  t. 
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The  solution  of  the  problem  (P6)  is  given  by  the 


following  theorem: 


Theorem  5.2 


For  the  system  shown  in  Figure  5.1,  the  optimal  decision 
rules  for  the  two-stage  decentralized  sequential  detection 
problem  (N=2)  are  as  follows: 


(a)  The  optimum  local  decision  rule  at  DM^  at  time  1  is 
described  by  the  I  RT , 


K.  CxU  s 


A  PCH^X1)  “1 


U,  =1 


u 


P(H0|xA)  u^=0  U1 


(5-17) 


where 


,  ElCl.  Ho)  -  ElC0,  H0)  f 

tu1  EjCO,  Hx)  -  Kj  (1,  i^) 


(5-18) 


MV  -  eu2|Ui>he2(u  » 


and 


Z.(u^,  H)  A  U  p(v2|u2,  H)  J(v,  H) 


(5-19) 


(b)  The  optimum  local  decision  rule  at  DM^  at  time  2  is 
described  by  the  LRT, 


OO  " 


u 


P (H, | x2)  U2=1 

>  *  K)  » 


>  ru  ,  '27  <  n  "u "~1- 

2  P (HQ | x  )  u2=0  2 


(5-20) 


where 
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Phenomenon 


DM- 

DM 

2 

u 

“  2 

Figure  5.1  A  Two-Detector  Tandem  topology 
Conf igurat ion . 


.  JKr.  VI  M  V\.  K"  A.™  H/!  s.*  \T  ^VVi^.T 


1  K.  .  %  .  X.  •  «»  "  a  ’ 


|WV' ATT-  vvvvsrvvv  vv  rjwwmini 


A  ^ ? ^U1  ’ ^ - ^ *  Ho)  ""  “2  ^U1 ,U2~® ’  Ho> 
tu2(ul)  =  l2(u1,u2=0,  H1)  -  Z2Cu1,u2=l,  Hx)  ' 


(5-21) 


(c)  The  optimum  decision  rules  at  DM2  are  described  by- 
three  thresholds  ai»  The  thresholds  satisfy  the 

following  equations: 


At  t  =  l 

ctj  J  (0 , 1)  +  (1  -  ax)  J(l,l) 


“l  P(u2'y2|Ho5 


Ey2’u2  2  ^ajP(u2 >y2 lHo5+  (1  '  J  P  Cu2  >y  2  I Hl^  ^ 


(5-22) 


ex  J(o, 0)  +  (1  -  6-p  J(i,o) 


r~T  r  S1  Pfu2,y2lHo) 

Ey2,u2  [J2  [S1P(u2,y2  |Hq)  +  (1  -  p  (u2  ,y2  |  H.^  ^ 1 


(5-23) 


where 


Ji  lp(H0|yu)l  ■ 


min  (  min  E  (J(v  ,H)|y  }  , 

vte[0,l]  yl’ul  r  u 


(5-24) 


(J7(p(h^  iy,,))  >> 


Jy2,u2  2  F  v  o  1 7  u 


At  t  =  2 


J(0,1) 

i  -  ji 

I1.1) 

j(i,o)  +  J(o,r 

i  -  Ji 

?0,0)  -  J(l,l) 

yyw. 
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At  each  timet,DM2  evaluates  P(HQ|y^)  using  its  observation 
and  compares  p(HQ|y^)  with  and  6^  (or  1 2  if  t  =  2)  .  De¬ 
cision  maker  2  decides  to  stop  or  continue  according  to  the 


following  rule 


At  t  =  l 


p(Ho|yi,ui)  £  ,  decide  ; 

pCHQ|y1,u1)  >  ,  decide  Hq  ; 


al  <  PCH0|yi,ui)  <  6^  ,  continue  to  take 

observations . 


At  t  =  2 


if  P(HQ  |y,j)  >  a2  , 


decide  H  ; 
o 


if  P(H0|y£)  <  . 


decide  ; 


C  5  -  2  6  ) 


where 


yu2  -  iyi>y2>  ui»u2}  and  >v  {yrui} 


Proof : 


The  objective  is  to  minimize 


R  =  E  (JCvt,H)} 


(5-27) 


The  decision  rule  at  time  1  for  DM^  is  obtained  as 


follows.  Writing  (5-27)  explicitly,  we  have 


R  =  l7  7  f  p(u2,v2,x2,y2,H)  J(v  ,H)  dx2dy2 
H,u2,v2  x2)y2 


(5-28) 


We  define 


11: 


J 


4 

■  »  v*  J* 
.  >  .  ■■  - 
•.v.vSfe 


■TV V V 
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Ssssss 


(5-29) 


Z0( u  ,H)  =  l2  I  p(v“ ,y“ |u“ ,H)  J(v  ,H)  dy 
V  Y2 

Substituting  (5-29)  in  (5-28),  we  get 

R  ■  l  2  p(u2,x2,H)  dx2  E,(u2,H)  ,  (5-30) 

H,“  ( 2 

where 

2  2 

P (u  ,x  ,H)  =  p(u2,x2|u1,x1,H)  p(u1|x1,H) 

•  p(H|Xl)  p(x2)  .  (5-31) 

Using  (5-11),  (5-31)  becomes 
2  2 

P (u  , x  ,H)  =  p(u2,x2|u1,x1,H)  p(u1|x1)  p(H|x1)  p(xx)  . 

(5-32) 

Substituting  (5-32)  in  (5-30),  and  integrating  with  respect 
to  all  values  of  x 2,  we  have 

R  =  I  2  |  p(u2Iui»xi»h)  p(ui!xi)  p(h!xx)  pCxx) 

X1 

•  dxx  E2(u2,H)  (5-33) 

Expanding  with  respect  to  u^  and  ignoring  a  constant  term, 
we  have 

f  P(x,)  P (u, =0 | x, )  l  p (H | x, ) 

i  H 

X1 

t  l  P(u2|u1=0,H)  £2(u1=0,u2,H) 
u2 

-  I  p(u2|u1=l,H)  E2(u1=0,u7,H) }  (5-34) 

u  2 
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Expression  (5-34)  is  minimized  if 


p(u1=0|x1)  = 


0  if  I  P  CH | xx3  {  J  p(u2|u1  =  0,H)  E2(u1  =  0,u2,H) 
H  u 


'  l  P(u2|u1=1,H)  E2(u1=1,u2,H)}  >  0 


1  otherwise 


(5-35) 


Expression  (5-35)  can  be  written  in  a  more  convenient  form 


p(u1=0lx1)  = 


0  if  E 


H|x1  {Eu2|u1  =  0,H  Z2ful  0  »U2 ,H^ 


:u2|u1=l,HE2(ul"1>u2>H^}  -  0 


1  otherwise  . 


(5-36) 


We  define 


I1(u1,H)  Eu2 |u1,H  Z2^U1,U2 


(5-37) 


From  (5-14),  it  follows  that 


E !  ( 1  ’  Hq )  1  Ei(0»Ho) 


(5-38) 


3  j  (  0  ,  H  x  )  >  IjU,  Hx) 


Using  (5-38),  we  then  obtain  the  following  decision  rule 


at  DMj  at  time  1, 


%  %  ^  ■*  ■*  N  l‘,  -i,  ->  .>  .•>  ,%  ,>  v>  fc’*  ^  „N  ^  .V  .N  ,V,‘ 

V\\  .V,1.  “  '  A -  ' 


■.v.vw.vAiwy 


which  is  the  desired  result  as  stated  in  Theorem  5.2(a). 


Next,  the  decision  rule  at  time  t  =  2  for  DM^  is  obtained. 


Starting  with  expression  (5-30),  we  have 

R  =  l  2  f  p(u2,x2,H)  dx2  Z?(u2 ,H)  .  (5-40) 

H  ,u  h.  z 

Using  Bayes  rule,  we  have 

p(u2,x2,H)  =  P (u2  j  x2 ,H)  P  (H | x2)  p(x2)  .  (5-41) 

Using  (5-11),  we  have 

P (u2 , x2 ,H)  =  p(u2|x2)  p (H  j  x2)  p(x2)  .  (5-42) 

Furthermore , 

p(u2|x2)  =  p(u2|u1,x4)  p(ux|x2)  .  (5-43) 

Using  (5-11),  we  have 

P(u"|x2)  =  p(u2|ux,x2)  p(u1|x1)  (5-44) 


Substituting  (5-44)  and  (5-42)  in  (5-40),  we  obtain 


R  =  l  ,  f  P  (H  ]  x2 )  p(u?|u,,x2)  pfuJx.)  p(x2) 
H,u“  h  1  1  1  1 

’  X 


•  2 2 (u2  , H)  dx2  .  (5-45) 

Explicitly  summing  over  u->,  and  neglecting  a  constant  term, 
we  have 


p(u2=0!u1,x  )  p(u1|x1)  p(x")  dx“ 


R-  l 

u. 

{  l  p(H|x2)  [Z2(u1,u2=0,H)  -  -2Cu1,u2=l,H)] }  (5-46) 

H 

Expression  (5-46)  is  minimized  by  setting 
2 

p(u2=0|u1,x  )  = 

0  if  l  p(H|x2) [E7(u, ,u?=0,H)  -  (u, ,u  =1 ,H) ]  >  0 

H  “  1  L 

■ 

1  otherwise  (5-4?) 

We  assume  that 


E  2  Cui » u2  =  0  » Hi ^ 


>  ?2(u1 .u2=l ,H1) 


(5-48) 


^2  (Ui  ,u2  =  l  ,Ho)^  /.2  (u^  ,u2  =  0  ,Ho) 

Note  that  (5-48)  follows  from  (5-14).  Expanding  (5-47)  over 
H,  we  obtain  the  decision  rule  for  DM^  at  time  2 


u2  =  l 

AU  (x2)  Z  tu  (ul} 

u2  .  u2  1 

u2  =  1 


(5-49) 


which  is  the  desired  result  of  Theorem  5.2(b). 


We  need  not  prove  part  (c)  of  the  theorem  in  detail 
because  the  results  can  be  obtained  by  a  straightforward 
application  of  the  results  of  Theorem  5-1.  This  completes 
the  proof  of  Theorem  5-2.  Q.E.D. 


1  01 


,yyy vyvwv,*^.,ws., 


In  Theorem  5-2,  we  presented  the  results  for  the 
two-stage  decentralized  sequential  detection  problem  for  a 
tandem  configuration.  The  above  results  can  easily  be  ex¬ 
tended  to  the  multi-stage  decentralized  sequential  detection 
problem.  The  results  are  stated  in  Theorem  5-3  without 
proof. 

Theorem  5-3 

Consider  the  configuration  shown  in  Fig.  5.1.  The 
optimal  decision  rules  for  the  multi-stage  decentralized 
sequential  detection  problem  are  given  as  follows: 


I 


I 


(a)  The  optimal  local  decision  rules  at  DM^  for 

t=l,...,N,  are  described  by  the  LRT ' s  given  below. 


At  t  =  ?  , 


For  ]<t<N 


At  t=N, 


where 


V*1) 


A  (x1-) 

ut 


u 


N 


r  N, 
) 


V1 


> 

u^  =  0 


V1 


4=0 


UN=  1 


4=0 


u, 


(5-50) 


t  (u*-1) 
ut 


(5-51) 


,  N-l> 
t  (u  ) 

UN 


(5-52) 


Next,  we  consider  the  decentralized  sequential  probability 


ratio  test  problem  using  the  Neyman- Pearson  approach. 


5.4.  A  Decentralized  Sequential  Probability  Ratio  Test 


Consider  a  distributed  detection  network  with  a  data 


fusion  center  as  shown  in  Figure  5.2.  We  solve  the  problem 


of  decentralized  sequential  probability  ratio  test.  We  use 


the  Neyman-Pearson  approach  for  system  optimization. 


The  problem  is  formulated  as  follows: 


(A. 13)  Consider  two  hypotheses  {Hq,  }  where  the  a  priori 


probability  of  Hq  is  given  by 


Prob  [H  ]  =  P 
L  o  1  o 


(A. 14)  DMX  makes  a  decision  ut  at  time  t  given  by 


ut  =  Vxt)  »  ut  e  {0> 


(5-  63) 


where  y  (•)  is  the  decision  rule  at  DM-^,  and 


xt  =  (x-^,...,  xt)  represents  the  set  of  obser¬ 
vations  at  DM^  up  to  time  t. 


(A. 15)  DM 2  makes  a  decision  v  at  time  t  given  by 


\  =  Yv(yt)  ,  vt  e  {0,  1} 


(5-64) 


Phenomenon 


■FAS 


where  y  (•)  is  the  decision  rule  at  DM.,  and  y  =  (y  ...,y  ) 

V  L  jL  t 

represents  the  set  of  observations  at  DM2  up  to  time  t. 


(A. 16)  The  observations  and  (y^,...,y  }  are 

assumed  to  be  mutually  independent  given 


the  hypothesis  H,  i.e.. 


L.  U 

p(Xi,...,x  ,  y  1 » •  •  • » y 1 1 H)  =  n  p ( x .  j h )  n  ply  -  |H)  . 

1  i=i  1  j=i  J 


(5-65) 


(A. 17)  The  data  fusion  center  performs  the  centralized 


sequential  probability  ratio  test  which  yields  the 


final  decision  d^  given  by 


dt  =  Ydt(ut’  Vt')  ’ 


(5-66) 


where  (ut>  vt)  are  the  decisions  at  DM^  and  DM2  at  time  t. 
Under  (A. 13) - (A. 17) ,  the  decentralized  sequential  proba¬ 
bility  ratio  test  problem  is  stated  as  follows: 


At  each  decision  maker  and  at  the  data 


fusion  center  ,find  the  decision  rules  yu(*),  yv(*)» 


and  (•)  so  as  to  minimize  the  function  F  given  by 


F  £  Pr  [dt  =  0  j  H  x ]  +  X  [Pr[dt  =  l|Ho]  -  a] 


under  the  constraint  that 


(5-67) 


Pr  [dt=l  |  H  ]  =  cc'  < 


X  =  the  Lagrange  multiplier 
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The  solution  to  problem  (P7)  is  given  by  the  follow¬ 


ing  theorem: 


Theorem  5.4 

For  the  system  shown  in  Figure  5.2,  the  optimal  de¬ 
cision  rules  for  the  two-stage  decentralized  sequential 
probability  ratio  test  problem  are  given  by 


(a)  The  optimal  decision  rule  at  DM^  at  time  1  is 
described  by  the  LRT. 


A„  (x")  # 


■  4  Pfx1 |HX>  U1 


u  =1 


U,  '  '  (  1  „  n  Au,  ’ 

1  p(x  H  )  u^=0  1 


where 


A  4  x  V  -  xitur°-  V 

U1  sjcuj-o,  H,)  -  z|(u,.l,  H,) 


'1^1 


(5-68) 


(5-69) 


and 


Zl(ul’  Hj)  "  Eu2|u1,Hj  Z2 (U1 ,u2 *Hj )  ’ 


Z2^ul,u2,Hi-!  =  l2  P  Cv2  1  H . )  p(dt=i  |u2,v2)  .  (5-70) 

J  \r  ^ 


We  also  have 


(b)  The  optimal  decision  rule  of  DM^  at  time  2  is  described 


by  the  LRT 


2  a  p(x2|H  )  u2=1 

V*  ’  -  ~  TT7-  5  „  \>7 

2  p(x  |Hq)  u2=0  2 


(5-72) 


where 


x  _  x  2 2  (ui  > u2  1,H0)  *  ^Ul’u2  °'H0) 

U2  Z2(u1,u2=0,H1)  -  Z2(u1,u2=1,H1) 


(5-73) 


p(u1,u2=1 |H0) 


a  -  Z2(u1,u2=0,Ho) 

£  2  *-Ul  ,U2=1  »Ho^  "  l2  ^U1  ,U2  =  0  ,Ho-* 


(5-74) 


p(u1  =  0  ,u2  =  0  |H)  =  pCXjjH)  p(x2|H)  dx1dx2 


where  D=  (x2:  A„  (x2)  £  tM  (•)  and  A,t  (x1)  £  tu  >  (5-75) 


—  u 


(c)  The  optimal  decision  rules  at  DM2  at  times  1  and  2  are 
obtained  by  interchanging  x  with  y  and  u  with  v  in 
equations  (5-68)  through  (5-75). 

(d)  The  decision  rule  at  the  data  fusion  center  is  given 
by  the  following  equation  : 


At  t=k  (k=l , 2 , . . . , N- 1 ) 

a  P^V  vt|Hl} 

If  A,  =  — -? — — - — — iT”T  >  T 

dt  P(V  vtiHoT  ~  1 


decide  H, 


If  <  T 

dt  -  o 


decide  H 


continue  to  take 
observations 


(5-76) 


If 


T  < 


o 


<  T, 


where 


and 


(5-77) 


(5-78) 


{Pm ,  Pp)  are  the  pre-assigned  probabilities  of  miss  and 
false  alarm  respectively. 


At  t  =  N 


,  p(V  vnIhi>  dt’  1 

I£  \  ■  p(“n"»nIV  dS  o 

V  0 

where  is  given  and  satisfies 


T  <  Tr  <  T. 
o  —  f  —  1 


(5-79) 


Proof : 

The  decision  rule  at  time  1  for  DM^  is  obtained  as 
follows : 

The  objective  function 

F  =  Pr{dt=0|H1}  +  X[Pr{dt=l |Hq}  -  a]  (5-80) 

2  2 

is  expanded  with  respect  to  u  and  v  to  get 


\  VJW VWA  PJk 7\X nx 'Uf  vy^’^YW.'WV  V 
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F  =  2^  2  P  Cdt  =  ° ,u2 ,v2 I np  +  X[  2  £  2  p(d  =1,u2,v2|H  )  -  a] 

u  ,v  u  ,v  ° 


2  2 


(5-81) 


Using  Bayes  rule,  (5-81)  yields 


F  =  2 ^  2  P(dt  =  0 lu2.v2)  P(uZ,vZ|H1) 

u  ,v  1 


2  2 


+  A[  2[  2  P(dt=1 I u2 » v2)  p(u“,vZ|H  )  -  a]  (5-82) 

u  ,v  ° 


Using  (5-63)  through  (5-65),  we  have 


F  =  l2  IHj)  l2  P(vZ|H1)  p(dt  =  0ju2,v2) 


+  X[£2  p(uz|Hq)  l2  P (vZ I H  )  p (d  =1  |u2, v2) -a]  (5-83) 

1  J  -\r  KJ  X, 


We  define 


v°r  2  u  ^ 

Z2(u  ,H0) 


-  ll  P(v'|Hq)  p(dt=0|u2,v2) 


(5-84) 


^2  (u2  >H1)  =  l2  p(v2|H,)  p  (d  =1  |  u2  ,  v2) 
v 

Substituting  (5-84)  and  (5-85)  in  (5-83),  we  get 


(5-85) 


F  -  I  P  (uj  »u2  |H1)  E^CUj.u^Hj) 
u2  ’  1 


[  I  p(u1,u2|Ho)e“(u1,u2,Ho)  -  „J 

U2’U  i 


(5-86) 
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By  minimizing  (5-95),  we  obtain  the  following  LRT : 


% 

a 


$ 


.53 


$ 


P  Cx1 |H, )  “l*1 

- T - -  $  Xu  ’  (5‘ 

p(x1|H1)  ux=0  1 

p(u1=0|H1)  =  a  (5- 

This  completes  the  proof  of  Theorem  5-4  (a). 

The  decision  rule  at  DM^  at  time  2  is  obtained  as 
follows.  Starting  with  expression  (5-86),  and  using  the 
fact  that  decision  u^  is  known  at  time  2,  we  get 


F  —  £  pfu-^jU^  |H^)  ^2(^1* ^2*^1^ 


(5-98) 


(5-99) 


+  A [ X  P (ui > u2 I H0^  E2(u1,U2’Ho)  " 


(5-100) 


Expanding  F  with  respect  to  u 2  and  ignoring  the  constant 
term,  we  have 


F  =  p(u1,u2=0 |HX)  [e2(u1,u2=0,H1)  -  F2(u1,u2=l,H1) ] 

+  A (p(u1,u2=l |Hq)  [Z2(u1,u2=1,Hq)  -  E2(u1,u2=0,Ho) ] 


+  E2  ^U1,U2  =  0,Ho')  ' 


Expression  (5-101)  can  be  written  as 


(5-101) 
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(a)  The  optimal  local  decision  rules  at  DMj  for  t»l . N 

are  described  by  the  LRT's  given  below  : 


where 


i  Ul’1 

Vx)  u<=0  S 


ut=1 


t-1 


(5-105) 


A  (xl)  >  A  (ut_i)  1  <  t  <  N  , 


ut=o 


uv=  1 

,  N,  N  ,  ,  N-l, 

V(x  >  i  n  Aun(u  5 

N  UN  0  N 


I°d.H0)  -  Ei(0,Ho) 
U1  z}(0,Hj)  -  zJfl.Hj) 


(5-106) 


(5-107) 


(5-108) 


,  .  t-l,  A  , 

Ut  U  •  :((ut'1,l,H1) 


1  <  t  <  N  , 


(5-109) 


^(ut,H)  =  E 


u\”  *  •  •  »  ut  + 1  I u  >” 


.  4(uN,H)  (5-110) 

I  , .  iN 


zj(uN,H)  $  [N  p  (v‘N  j  H)  p(dt=i!u\v")  ,  (5-111) 


N  N, 


(uN,h)  =  e  N  pfd  =i!uN,vN)  . 
iN  v  j  H  r 


(5-112) 
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Finally  , 


a  -  Z°(ut'1,0,Ho) 


Z°(ut'1,l,H(j)  -Zt°(ut'1,0,Ho) 


(5-115) 


(b)  The  optimal  decision  rules  at  DM2  at  all  times  are 
obtained  by  interchanging  x  with  y  and  u  with  v  in 
equations  (5-105)  through  (5-115). 

(c)  The  decision  rule  at  the  data  fusion  center  is  given 
by  Theorem  5.4(d)  . 


5 -  5 .  Discuss  ion 

In  this  chapter,  we  have  considered  two  decentralized 
sequential  detection  problems  namely:  the  Bayesian  sequential 
hypothesis  testing  problem  for  a  tandem  topology  network,  and 
the  decentralized  sequential  probability  ratio  test  problem. 
In  both  problems,  we  derived  the  decision  rules  at  each  de¬ 
cision  maker  at  each  time  stage.  Under  the  assumption  that 
the  observations  are  conditionally  independent;  the  decision 
rules  are  likelihood  ratio  test  (LRT) .  Furthermore,  the 
threshold  of  each  decision  maker  at  time  t  depends  on  all  of 
its  previous  decisions.  However,  all  threshold  equations 
are  coupled  at  all  times.  One  needs  to  solve  these  equations 
simultaneously  in  order  to  obtain  a  solution  for  the  thresh¬ 
olds.  The  coupling  between  the  threshold  equations  causes 
considerable  complexity  in  the  computation  of  the  optimal 
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CHAPTER  SIX 


SUMMARY  AND  SUGGESTIONS  FOR  FUTURE  RESEARCH 


6 . 1  Summary 


In  this  Report  ,  we  have  considered  some  hypothesis 
testing  problems  where  the  detection  network  consists  of  a 
multitude  of  geographically  distributed  decision  makers.  We 
investigated  distributed  detection  problems  for  various  net¬ 
work  topologies.  First,  we  considered  two  schemes  for  data 
fusion  namely,  centralized  data  fusion  and  distributed  data 
fusion.  Next,  the  distributed  detection  problem  with  dis¬ 
tributed  data  fusion  was  solved  using  the  Bayesian  approach 
as  well  as  the  Neyman-Pearson  approach.  Then,  the  Neyman- 
Pearson  detection  problem  and  the  sequential  hypothesis 
testing  problem  for  a  tandem  topology  was  solved.  Finally, 
the  distributed  sequential  probability  ratio  test  was  in¬ 
vestigated.  In  all  cases,  we  have  derived  the  optimal 
strategies  at  each  decision  maker.  The  decision  rules  at 
each  decision  maker  turn  out  to  be  LRT's  where  the  thresholds 
are  described  by  a  set  of  coupled  nonlinear  equations.  The 
simultaneous  solution  of  these  equations  yields  the  set  of 
thresholds.  There  may  be  several  local  solutions.  Each  must 
be  checked  to  assure  that  a  global  minimum  is  found. 
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6 . 2  Suggestions  for  Future  Research 

Optimal  decisions  rules  have  been  derived  for  various 
distributed  detection  problems  in  this  Report  .  The 

thresholds  associated  with  the  decision  rules  are  obtained 
through  the  solution  of  coupled  nonlinear  equations.  The 
computation  of  the  numerical  values  of  the  thresholds  is 
extremely  difficult  and  involved.  Therefore,  efficient 
computational  algorithms  for  the  solution  of  the  threshold 
equations  should  be  developed. 

Throughout  this  Report  ,  we  have  assumed  that  the 

observations  are  conditionally  independent  as  is  the  case 
in  most  of  the  published  literature.  Hypothesis  testing 
problems  with  dependent  observations  should  be  investigated 
due  to  its  wide  practical  applications. 

Different  structures  (topology,  communication  protocol 
etc...)  of  distributed  detection  systems  should  also  be 
studied,  i.e.,  how  should  one  organize  the  various  decision 
makers  in  a  detection  network  in  order  to  maximize  the  per¬ 
formance  of  the  overall  system? 
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